2026-02-08 04:00:17.706 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.service.iam.user.UserService : user 100 login with organization 10000000 2026-02-08 04:00:17.715 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=13023412, context=Context{parallelIdx=-1, stringMap={checkBeforeDataBackup=true, scheduleTime=04:00:00, ob_version=4.3.5.0, startClusterCompact=true, task_instance_id=13015560, dataBackupTriggerInfo={"async":true,"backupDimension":"CLUSTER","dataBackupMode":"FULL_BACKUP","triggerTime":"2026-02-07T20:00:12Z","triggerType":"SCHEDULED"}, task_operation=execute, triggerTime=1770494412000000, ob_cluster_id=1738739618, startLogBackup=true, backupDim=CLUSTER, dataSetIncIdMap={"1028":"7000178","1004":"7000174","1048":"7000177","1026":"7000173","1002":"7000175","1034":"7000179","1030":"7000176"}, cluster_id=1000002, tenantName=*, backupMode=physical, scheduleDayMode={"1":"INCREMENTAL_BACKUP","2":"INCREMENTAL_BACKUP","3":"INCREMENTAL_BACKUP","4":"INCREMENTAL_BACKUP","5":"INCREMENTAL_BACKUP","6":"INCREMENTAL_BACKUP","7":"FULL_BACKUP"}, scheduleMode=week, triggerType=SCHEDULED, latest_execution_start_time=2026-02-08T04:00:17.661+08:00, sub_task_instance_name=Wait data backup task successful, sub_task_instance_id=13023412, obClusterName=Inzone_OceanBase}, listMap={}}, executor=10.0.86.109 2026-02-08 04:00:17.724 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=1 2026-02-08 04:00:17.811 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:17.818 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:17.826 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:17.834 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:17.840 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:17.849 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:17.858 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:17.864 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:17.870 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:17.878 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:17.886 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:17.894 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:00:17.902 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:17.909 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:17.918 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:17.924 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:17.930 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:17.937 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:17.944 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:00:17.994 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:18.000 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:18.006 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:18.012 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:18.019 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:18.026 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:18.053 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:00:18.617 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-0 2-07T20:00:15.886048Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=INITIALIZING, progress=null, errorMsg=}] 2026-02-08 04:00:18.631 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.637 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.644 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.652 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.659 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.665 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.674 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : task status is UNKNOWN 2026-02-08 04:00:18.682 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:00:48.689 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=2 2026-02-08 04:00:48.756 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:00:48.765 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:48.772 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:48.779 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:48.786 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:48.793 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:48.801 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:48.809 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:48.815 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:48.821 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:48.826 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:48.833 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:48.841 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:00:48.848 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:48.857 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:48.862 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:48.869 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:48.875 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:48.881 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:48.887 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:00:48.936 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:00:48.944 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:00:48.952 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:00:48.960 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:00:48.969 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:00:48.977 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:00:49.005 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:00:49.156 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:00:49.205 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:01:19.212 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=3 2026-02-08 04:01:19.285 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:01:19.293 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:19.300 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:19.307 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:19.316 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:19.323 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:19.330 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:19.336 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:19.343 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:19.350 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:19.357 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:19.365 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:19.373 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:01:19.382 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:19.389 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:19.395 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:19.402 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:19.411 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:19.418 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:19.426 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:01:19.480 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:19.488 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:19.495 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:19.502 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:19.509 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:19.517 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:19.547 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:01:19.704 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:01:19.726 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:01:49.733 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=4 2026-02-08 04:01:49.799 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:01:49.807 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:49.813 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:49.820 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:49.825 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:49.832 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:49.839 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:49.846 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:49.852 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:49.858 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:49.865 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:49.871 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:49.878 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:01:49.883 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:49.889 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:49.894 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:49.899 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:49.904 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:49.910 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:49.917 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:01:49.969 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:01:49.976 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:01:49.981 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:01:49.987 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:01:49.993 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:01:49.998 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:01:50.028 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:01:50.183 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:01:50.203 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:02:20.212 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=5 2026-02-08 04:02:20.268 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:02:20.274 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:20.279 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:20.283 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:20.288 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:20.299 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:20.305 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:20.310 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:20.315 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:20.320 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:20.324 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:20.330 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:20.335 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:02:20.341 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:20.346 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:20.352 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:20.357 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:20.363 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:20.370 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:20.376 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:02:20.425 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:20.431 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:20.437 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:20.443 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:20.447 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:20.453 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:20.480 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:02:20.622 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:02:20.642 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:02:50.648 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=6 2026-02-08 04:02:50.706 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:02:50.712 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:50.718 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:50.722 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:50.731 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:50.737 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:50.743 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:50.750 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:50.756 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:50.762 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:50.767 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:50.773 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:50.779 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:02:50.788 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:50.794 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:50.799 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:50.804 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:50.809 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:50.816 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:50.822 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:02:50.872 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:02:50.879 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:02:50.885 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:02:50.891 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:02:50.897 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:02:50.904 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:02:50.929 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:02:51.076 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:02:51.096 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:03:21.102 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=7 2026-02-08 04:03:21.174 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:03:21.181 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:21.191 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:21.196 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:21.201 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:21.207 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:21.212 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:21.217 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:21.222 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:21.228 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:21.233 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:21.239 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:21.245 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:03:21.251 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:21.257 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:21.262 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:21.267 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:21.272 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:21.280 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:21.285 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:03:21.342 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:21.349 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:21.355 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:21.364 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:21.369 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:21.375 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:21.403 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:03:21.548 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:03:21.567 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:03:51.573 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=8 2026-02-08 04:03:51.629 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:03:51.635 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:51.640 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:51.645 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:51.650 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:51.655 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:51.660 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:51.667 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:51.672 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:51.677 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:51.683 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:51.688 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:51.694 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:03:51.700 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:51.705 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:51.711 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:51.716 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:51.721 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:51.727 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:51.733 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:03:51.783 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:03:51.790 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:03:51.795 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:03:51.799 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:03:51.805 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:03:51.811 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:03:51.837 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:03:51.986 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:03:52.006 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:04:22.011 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=9 2026-02-08 04:04:22.076 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:04:22.083 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:22.089 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:22.096 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:22.102 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:22.108 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:22.115 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:22.122 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:22.127 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:22.134 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:22.141 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:22.148 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:22.156 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:04:22.168 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:22.178 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:22.186 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:22.197 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:22.206 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:22.213 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:22.220 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:04:22.272 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:22.279 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:22.291 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:22.306 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:22.315 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:22.322 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:22.350 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:04:22.499 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:04:22.560 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:04:52.567 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=10 2026-02-08 04:04:52.636 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:04:52.642 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:52.648 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:52.654 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:52.661 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:52.668 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:52.675 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:52.681 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:52.687 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:52.693 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:52.699 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:52.705 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:52.712 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:04:52.719 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:52.724 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:52.730 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:52.736 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:52.742 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:52.748 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:52.756 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:04:52.805 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:04:52.811 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:04:52.816 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:04:52.822 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:04:52.826 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:04:52.832 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:04:52.864 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:04:53.016 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=n ull, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:04:53.035 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 7 2026-02-08 04:05:23.041 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=11 2026-02-08 04:05:23.120 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:23.127 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:23.134 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:23.142 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:23.148 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:23.155 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:23.162 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:23.168 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:23.175 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:23.181 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:23.187 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:23.195 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:05:23.202 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:23.208 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:23.215 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:23.220 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:23.227 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:23.233 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:23.241 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:05:23.292 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:23.299 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:23.307 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:23.315 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:23.321 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:23.329 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:23.356 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:05:23.505 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=fil e:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:05:23.529 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 6 2026-02-08 04:05:53.535 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=12 2026-02-08 04:05:53.592 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:05:53.598 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:53.602 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:53.607 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:53.612 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:53.617 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:53.623 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:53.628 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:53.633 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:53.639 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:53.644 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:53.648 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:53.654 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:05:53.660 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:53.665 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:53.669 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:53.674 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:53.678 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:53.684 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:53.690 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:05:53.740 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:05:53.747 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:05:53.751 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:05:53.756 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:05:53.760 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:05:53.765 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:05:53.792 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:05:53.946 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB4 20A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:05:53.972 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 5 2026-02-08 04:06:23.979 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=13 2026-02-08 04:06:24.054 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:06:24.061 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:24.066 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:24.073 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:24.079 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:24.085 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:24.094 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:24.100 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:24.106 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:24.113 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:24.120 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:24.127 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:24.133 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:06:24.140 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:24.155 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:24.163 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:24.171 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:24.180 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:24.187 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:24.193 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:06:24.243 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:24.249 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:24.255 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:24.261 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:24.270 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:24.278 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:24.307 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:06:24.457 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB4 20A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:06:24.508 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 4 2026-02-08 04:06:54.518 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=14 2026-02-08 04:06:54.601 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:06:54.609 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:54.632 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:54.647 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:54.653 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:54.659 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:54.664 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:54.670 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:54.676 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:54.686 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:54.691 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:54.697 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:54.704 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:06:54.710 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:54.717 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:54.751 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:54.762 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:54.770 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:54.777 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:54.786 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:06:54.837 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:06:54.859 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:06:54.866 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:06:54.872 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:06:54.879 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:06:54.885 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:06:54.913 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:06:55.092 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=2026-02-07T20:06:32.516382Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A00566F-00062E392EC54F3A-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:0 5:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:06:55.165 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 3 2026-02-08 04:07:25.171 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=15 2026-02-08 04:07:25.239 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:07:25.250 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:25.258 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:25.265 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:25.273 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:25.279 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:25.287 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:25.294 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:25.301 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:25.307 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:25.313 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:25.320 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:25.326 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:07:25.333 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:25.341 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:25.348 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:25.357 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:25.365 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:25.372 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:25.381 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:07:25.436 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:25.449 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:25.457 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:25.466 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:25.473 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:25.483 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:25.510 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:07:25.683 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=2026-02-07T20:06:32.516382Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A00566F-00062E392EC54F3A-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=2026-02-07T20:07:22.411330Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A005674-00063E732C2EDC93-0-0}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=null, status=DOING, progress=null, errorMsg=}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obback up/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:07:25.737 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 2 2026-02-08 04:07:55.744 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=16 2026-02-08 04:07:55.799 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:07:55.804 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:55.809 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:55.814 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:55.819 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:55.823 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:55.828 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:55.834 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:55.839 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:55.845 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:55.851 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:55.856 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:55.861 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:07:55.867 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:55.873 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:55.877 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:55.882 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:55.886 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:55.891 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:55.897 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:07:55.943 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:07:55.950 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:07:55.956 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:07:55.961 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:07:55.965 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:07:55.970 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:07:55.998 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:07:56.140 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=2026-02-07T20:06:32.516382Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A00566F-00062E392EC54F3A-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=2026-02-07T20:07:22.411330Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A005674-00063E732C2EDC93-0-0}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=2026-02-07T20:07:44.279605Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A00566F-00062 E423F5BB5B7-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=null, status=DOING, progress=null, errorMsg=}] 2026-02-08 04:07:56.182 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : count running backup task size: 1 2026-02-08 04:08:26.188 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : try to check data backup task finished, retryTimes=17 2026-02-08 04:08:26.252 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=Inzone_OceanBase, tenantName=sys, dbUser=ocp_monitor 2026-02-08 04:08:26.260 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:08:26.267 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:08:26.274 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:08:26.279 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:08:26.285 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:08:26.294 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:08:26.301 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:08:26.307 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:08:26.314 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:08:26.321 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:08:26.327 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:08:26.334 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW VARIABLES LIKE 'system_time_zone' 2026-02-08 04:08:26.342 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:08:26.350 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:08:26.356 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:08:26.363 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:08:26.369 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:08:26.378 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:08:26.385 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, name, value, gmt_create, gmt_modified FROM __all_virtual_sys_variable WHERE name = ? 2026-02-08 04:08:26.433 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.111, port=2881, database=oceanbase) 2026-02-08 04:08:26.440 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.112, port=2881, database=oceanbase) 2026-02-08 04:08:26.448 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.113, port=2881, database=oceanbase) 2026-02-08 04:08:26.456 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.114, port=2881, database=oceanbase) 2026-02-08 04:08:26.462 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.obsdk.connector.ObConnectorHolder : [obsdk] no ob connector found in holder, key=ObConnectorKey(connectionMode=direct, clusterName=Inzone_OceanBase, obClusterId=1738739618, tenantName=sys, username=ocp_monitor, address=10.0.86.115, port=2881, database=oceanbase) 2026-02-08 04:08:26.468 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000] 2026-02-08 04:08:26.496 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select * from (SELECT job_id, incarnation, job.tenant_id AS tenant_id, job.backup_set_id AS backup_set_id, backup_type, path AS backup_dest, start_timestamp AS start_time, end_timestamp AS end_time, now(6) AS check_time, task.data_progress AS data_progress, status, comment, description, 'TENANT' AS backup_level, file.min_restore_scn_display AS snapshot_version_time, output_bytes FROM ( SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, NULL AS end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOBS UNION SELECT job_id, incarnation, tenant_id, backup_set_id, backup_type, path, start_timestamp, end_timestamp, status, comment, description FROM CDB_OB_BACKUP_JOB_HISTORY ) job LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, min_restore_scn_display, output_bytes FROM CDB_OB_BACKUP_SET_FILES) file ON job.tenant_id = file.tid AND job.backup_set_id = file.backup_set_id LEFT JOIN (SELECT tenant_id AS tid, backup_set_id, data_progress FROM CDB_OB_BACKUP_TASKS) task ON job.tenant_id = task.tid AND job.backup_set_id = task.backup_set_id WHERE tenant_id != 1 AND description = ? ORDER BY start_time DESC) where start_time >= '2026-02-08 04:00:12', args: [ALTER BACKUP CLUSTER FULL_BACKUP BY SCHEDULED AT 2026-02-08 04:00:12.0] 2026-02-08 04:08:26.640 INFO 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task: [DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=2026-02-07T20:06:32.516382Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A00566F-00062E392EC54F3A-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=2026-02-07T20:07:22.411330Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A005674-00063E732C2EDC93-0-0}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005673-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=2026-02-07T20:07:44.279605Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A00566F-00062 E423F5BB5B7-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}, DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=2026-02-07T20:08:10.443660Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E73AE87A76C-0-0}] 2026-02-08 04:08:26.695 WARN 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.b.i.t.s.WaitDataBackupSuccessTask : check backup task failed: [DataBackupHistoryWrapperTask{taskId=303, backupType=FULL, clusterId=null, obTenantId=1026, backupSetId=303, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1026/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.718949Z, finishTime=2026-02-07T20:08:10.443660Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E73AE87A76C-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1028, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1028/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.595236Z, finishTime=2026-02-07T20:07:22.411330Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A005674-00063E732C2EDC93-0-0}, DataBackupHistoryWrapperTask{taskId=304, backupType=FULL, clusterId=null, obTenantId=1030, backupSetId=304, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1030/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.208326Z, finishTime=2026-02-07T20:07:44.279605Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A00566F-00062E423F5BB5B7-0-0}, DataBackupHistoryWrapperTask{taskId=32, backupType=FULL, clusterId=null, obTenantId=1048, backupSetId=32, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1048/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.443874Z, finishTime=2026-02-07T20:05:20.816636Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.115:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A0056 73-00063E24E1780608-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1002, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1002/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.043607Z, finishTime=2026-02-07T20:05:34.358589Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.114:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005672-00062EEE1823461B-0-0}, DataBackupHistoryWrapperTask{taskId=248, backupType=FULL, clusterId=null, obTenantId=1034, backupSetId=248, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1034/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:16.812325Z, finishTime=2026-02-07T20:06:32.516382Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.111:2882, module: BACKUP_DATA, result: -4012(Timeout), trace_id: YB420A00566F-00062E392EC54F3A-0-0}, DataBackupHistoryWrapperTask{taskId=317, backupType=FULL, clusterId=null, obTenantId=1004, backupSetId=317, backupDest=file:///nfs/obbackup/Inzone_OceanBase/1738739618/tenant_incarnation_1/1004/data, snapshotVersionTime=null, startTime=2026-02-07T20:00:15.886048Z, finishTime=2026-02-07T20:06:06.802869Z, status=FAILED, progress=null, errorMsg=(SERVER)ls_id: 1, addr: 10.0.86.116:2882, module: BACKUP_DATA, result: -4009(IO error), trace_id: YB420A005674-00063E739AE75942-0-0}] 2026-02-08 04:08:26.708 ERROR 63166 --- [subtask-executor26,0a3bbcbbcfecbef2,4aebd7029e669443] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : Data backup task failed. com.oceanbase.ocp.core.exception.UnexpectedException: [OCP UnexpectedException]: status=500 INTERNAL_SERVER_ERROR, errorCode=BACKUP_DATA_BACKUP_TASK_FAILED, args= at com.oceanbase.ocp.backup.internal.task.schedule.WaitDataBackupSuccessTask.checkDataBackupTaskFinished(WaitDataBackupSuccessTask.java:172) at com.oceanbase.ocp.backup.internal.task.schedule.WaitDataBackupSuccessTask.lambda$run$5(WaitDataBackupSuccessTask.java:218) at com.github.rholder.retry.AttemptTimeLimiters$NoAttemptTimeLimit.call(AttemptTimeLimiters.java:78) at com.github.rholder.retry.Retryer.call(Retryer.java:160) at com.oceanbase.ocp.backup.internal.task.schedule.WaitDataBackupSuccessTask.run(WaitDataBackupSuccessTask.java:213) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:206) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:200) at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Set state for subtask: 13023412, operation:EXECUTE, state: FAILED