2023-05-17 20:13:17.425  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.o.c.t.e.runner.JavaSubtaskRunner     : Run subtask, id=175341, context=Context{parallelIdx=-1, stringMap={cluster_name=obcluster, cluster_id=2, ocpagent_service_name=agent, prohibit_rollback=false, former_cluster_status=RUNNING, target_zone_status=RUNNING, task_instance_id=154045, task_operation=execute, zone_name=zone1, target_cluster_status=RUNNING, latest_execution_start_time=2023-05-17T20:13:17.361+08:00, sub_task_instance_id=175341}, listMap={server_ids=[3]}}, executor=10.168.89.10

2023-05-17 20:13:17.437  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.o.s.t.business.zone.StopObZoneTask   : try to stop zone by ob cmd, clusterId=2, obClusterId=1, clusterType=PRIMARY, zoneName=zone1

2023-05-17 20:13:17.439  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.o.s.t.b.zone.ObZoneTaskHandler       : begin to stop zone, clusterId=2, zone=zone1

2023-05-17 20:13:17.456  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ObConnectors     : [obsdk]:connected server ip:10.168.89.11, sql port:2981

2023-05-17 20:13:17.459  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ObConnectors     : [obsdk]:connected server ip:10.168.89.11, sql port:2981

2023-05-17 20:13:17.461  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2023-05-17 20:13:17.464  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = 'min_observer_version'

2023-05-17 20:13:17.471  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ObConnectors     : [obsdk]:connected server ip:10.168.89.11, sql port:2981

2023-05-17 20:13:17.473  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2023-05-17 20:13:17.476  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: SELECT `zone`, `status`, `region`, `idc` FROM `DBA_OB_ZONES`

2023-05-17 20:13:17.480  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ObConnectors     : [obsdk]:connected server ip:10.168.89.11, sql port:2981

2023-05-17 20:13:17.482  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2023-05-17 20:13:17.485  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: set ob_query_timeout = ?, args: [1800000000]

2023-05-17 20:13:17.488  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: alter system stop zone ?, args: [zone1]

Set state for subtask: 175341, operation:EXECUTE, state: FAILED
2023-05-17 20:43:17.380  WARN 11 --- [pool-subtask-executor22,72483ec36ef241e0,b841216972a3] c.o.o.c.t.e.c.w.s.TimeoutSubtaskWorker   : Receive timeout callback, id=175341, name=Stop zone, elapsed=1800, timeout=1800

plate.java:245) [obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.update(ConnectTemplate.java:235) [obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.operator.cluster.MysqlClusterOperator.stopZone(MysqlClusterOperator.java:481) [obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.lambda$tryOperateZone$2(ObZoneTaskHandler.java:79) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.common.pattern.Retry.executeUntilWithLimit(Retry.java:72) ~[ocp-common-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.tryOperateZone(ObZoneTaskHandler.java:77) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.stopZone(ObZoneTaskHandler.java:56) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.StopObZoneTask.run(StopObZoneTask.java:55) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:60) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:111) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.redirectOutputIfNotSysSchedule(RunnerFactory.java:183) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.run(RunnerFactory.java:101) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ReadySubtaskW
orker.lambda$null$1(ReadySubtaskWorker.java:127) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312]
	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312]


2023-05-17 20:43:17.581 ERROR 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] update failed, sql:[alter system stop zone ?], error message:[PreparedStatementCallback; SQL [alter system stop zone ?]; (conn=3221706767) Connection timed out; nested exception is java.sql.SQLNonTransientConnectionException: (conn=3221706767) Connection timed out]

2023-05-17 20:43:17.585  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : Last Trace Info:[YBA60AA8590B-0005F9C3D1EA6989-0-0]

2023-05-17 20:43:17.586  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] slow query, durationMillis=1800098, sql=alter system stop zone ?

2023-05-17 20:43:17.588  INFO 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.ocp.obsdk.connector.ConnectTemplate  : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2023-05-17 20:43:17.593  WARN 11 --- [pool-manual-subtask-executor16,f3ff13a6ad6c434b,fb1d4d5d86d0] c.o.o.c.t.engine.runner.RunnerFactory    : Execute task failed, subtask=SubtaskInstanceOverview{id=175341, name=Stop zone, state=FAILED, operation=CANCEL, className=com.oceanbase.ocp.service.task.business.zone.StopObZoneTask, seriesId=7, startTime=2023-05-17T20:13:17.362+08:00, endTime=null}

com.oceanbase.ocp.obsdk.exception.OceanBaseException: (conn=3221706767) Connection timed out
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.customizeException(ConnectTemplate.java:395) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.customizeException(ConnectTemplate.java:387) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.customizeException(ConnectTemplate.java:382) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.updateInner(ConnectTemplate.java:249) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.update(ConnectTemplate.java:235) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.obsdk.operator.cluster.MysqlClusterOperator.stopZone(MysqlClusterOperator.java:481) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.lambda$tryOperateZone$2(ObZoneTaskHandler.java:79) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.common.pattern.Retry.executeUntilWithLimit(Retry.java:72) ~[ocp-common-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.tryOperateZone(ObZoneTaskHandler.java:77) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.ObZoneTaskHandler.stopZone(ObZoneTaskHandler.java:56) ~[ocp-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.service.task.business.zone.StopObZoneTask.run(StopObZoneTask.java:55) ~[oc
p-service-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:60) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:111) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.redirectOutputIfNotSysSchedule(RunnerFactory.java:183) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.run(RunnerFactory.java:101) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.ReadySubtaskWorker.lambda$null$1(ReadySubtaskWorker.java:127) ~[ocp-core-4.0.3-20230301.jar!/:4.0.3-20230301]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_312]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_312]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_312]
	at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_312]
Caused by: java.sql.SQLNonTransientConnectionException: (conn=3221706767) Connection timed out
	at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.createException(ExceptionFactory.java:122) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.util.exceptions.ExceptionFactory.create(ExceptionFactory.java:202) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.OceanBaseStatement.executeExceptionEpilogue(OceanBaseStatement.java:315) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:243) ~[oceanbase-client-2
.4.2.jar!/:na]
	at com.oceanbase.jdbc.JDBC4PreparedStatement.execute(JDBC4PreparedStatement.java:161) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.JDBC4PreparedStatement.executeUpdate(JDBC4PreparedStatement.java:195) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.alibaba.druid.pool.DruidPooledPreparedStatement.executeUpdate(DruidPooledPreparedStatement.java:255) ~[druid-1.2.8.jar!/:1.2.8]
	at org.springframework.jdbc.core.JdbcTemplate.lambda$update$2(JdbcTemplate.java:965) ~[spring-jdbc-5.3.23.jar!/:5.3.23]
	at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:651) ~[spring-jdbc-5.3.23.jar!/:5.3.23]
	at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:960) ~[spring-jdbc-5.3.23.jar!/:5.3.23]
	at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1015) ~[spring-jdbc-5.3.23.jar!/:5.3.23]
	at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:1025) ~[spring-jdbc-5.3.23.jar!/:5.3.23]
	at com.oceanbase.ocp.obsdk.connector.ConnectTemplate.updateInner(ConnectTemplate.java:245) ~[obsdk-4.0.3-20230301.jar!/:4.0.3-20230301]
	... 18 common frames omitted
Caused by: com.oceanbase.jdbc.internal.util.exceptions.OceanBaseSqlException: Connection timed out
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:197) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.exceptionWithQuery(AbstractQueryProtocol.java:180) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:372) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.JDBC4PreparedStatement.executeInternal(JDBC4PreparedStatement.java:234) ~[oceanbase-client-2.4.2.jar!/:na]
	... 27 common frames omitted
Caused by: java.sql.SQLNonTransientConnectionException: Read timed out
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.handleIoException(AbstractQueryProtocol.java:2559) ~[oceanbase-client-2.4.
2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2041) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.getResult(AbstractQueryProtocol.java:1951) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.executeQuery(AbstractQueryProtocol.java:370) ~[oceanbase-client-2.4.2.jar!/:na]
	... 28 common frames omitted
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method) ~[na:1.8.0_312]
	at java.net.SocketInputStream.socketRead(SocketInputStream.java:116) ~[na:1.8.0_312]
	at java.net.SocketInputStream.read(SocketInputStream.java:171) ~[na:1.8.0_312]
	at java.net.SocketInputStream.read(SocketInputStream.java:141) ~[na:1.8.0_312]
	at java.io.FilterInputStream.read(FilterInputStream.java:133) ~[na:1.8.0_312]
	at com.oceanbase.jdbc.internal.io.input.ReadAheadBufferedStream.fillBuffer(ReadAheadBufferedStream.java:148) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.io.input.ReadAheadBufferedStream.read(ReadAheadBufferedStream.java:121) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.io.input.Ob20PacketInputStream.readFully(Ob20PacketInputStream.java:177) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.io.input.Ob20PacketInputStream.resolveOb20Packet(Ob20PacketInputStream.java:147) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.io.input.Ob20PacketInputStream.getPacketArray(Ob20PacketInputStream.java:95) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.io.input.Ob20PacketInputStream.getPacket(Ob20PacketInputStream.java:88) ~[oceanbase-client-2.4.2.jar!/:na]
	at com.oceanbase.jdbc.internal.protocol.AbstractQueryProtocol.readPacket(AbstractQueryProtocol.java:2039) ~[oceanbase-client-2.4.2.jar!/:na]
	... 30 common frames omitted