执行OBSERVER替换任务，老OBSERVER一直在DELETING，16个小时了还没结束

都叫我浮云 · 2025 年5 月 8 日 09:07

请协助看看是什么问题？

2025-05-07 18:07:10.335 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

2025-05-07 18:07:10.341 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2025-05-07 18:07:10.372 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

2025-05-07 18:07:10.401 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=1735726419464397, blockMigrateInTime=0, id=null)

2025-05-07 18:07:10.408 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

2025-05-07 18:07:30.431 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

2025-05-07 18:07:30.435 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2025-05-07 18:07:30.440 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

2025-05-07 18:07:30.448 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=1735726419464397, blockMigrateInTime=0, id=null)

2025-05-07 18:07:30.451 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

2025-05-07 18:07:50.454 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

2025-05-07 18:07:50.458 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2025-05-07 18:07:50.463 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

2025-05-07 18:07:50.468 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=1735726419464397, blockMigrateInTime=0, id=null)

2025-05-07 18:07:50.471 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

2025-05-07 18:08:10.473 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

2025-05-07 18:08:10.480 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

2025-05-07 18:08:10.489 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

2025-05-07 18:08:10.496 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=1735726419464397, blockMigrateInTime=0, id=null)

2025-05-07 18:08:10.501 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,b71ec2345d39d8a0] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

都叫我浮云 · 2025 年5 月 8 日 09:10

描述补充：
目前看到新加入的节点已经容量已经与老节点一致，在等待老节点进行删除任务的时候卡住了，目前新OBSERVER节点一直没有替换成功。

Coca-cola · 2025 年5 月 8 日 09:10

先暂停，再手动关闭server，再开始试试呢？

都叫我浮云 · 2025 年5 月 8 日 09:36

我关闭老节点OBSERVER服务之后，重新运行了当前任务节点，下面是日志
2025-05-08 09:33:26.357 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.c.t.e.runner.JavaSubtaskRunner : Retry subtask, id=4007872, context=Context{parallelIdx=-1, stringMap={ob_log_disk_path=/redo/st2-ob02, task_instance_id=4005013, task_operation=retry, ob_run_path=/opt/oceanbase/oceanbase, service_version=4.2.5.1, ob_install_path=/opt/oceanbase/oceanbase, ob_sql_port=2881, cluster_id=3, ob_disk_path_style=DEFAULT, ob_svr_port=2882, sub_task_instance_name=Wait observer delete, sub_task_instance_id=4007872, cluster_name=st2_ob02, target_server_status=DELETED, subtask_splitter=server_ids, service_name=st2_ob02:1732430707, former_cluster_status=RUNNING, target_zone_status=RUNNING, former_zone_status=RUNNING, service_type=OB_CLUSTER, target_cluster_status=RUNNING, ob_run_user=admin, latest_execution_start_time=2025-05-08T09:33:26.338+08:00, former_server_status=RUNNING, ob_data_disk_path=/data/st2-ob02}, listMap={server_ids=[8], host_ids=[32], skip_operation_host_ids=[], zone_names=[zone01]}}, executor=192.168.180.154

2

3

2025-05-08 09:33:26.360 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.s.AbstractWaitObServerTask : do nothing when rollback

4

5

2025-05-08 09:33:26.420 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.s.AbstractWaitObServerTask : get observer list, serverList=[Server(id=null, ip=192.168.180.31, port=2882, sqlPort=null, runUser=null, runPath=null, installPath=null, version=null, withRootserver=null, status=CREATING, innerStatus=null, operatingTaskInstanceId=null, statusAnalysis=null, updateTime=null, clusterId=null, zoneName=null, regionName=null, idcName=null, hostId=null, hostTypeName=null, hostStatus=null, startTime=null, stopTime=null, stats=null, availableOperations=null, performanceStats=null, arbitrationStatus=ACTIVE, onlineCpuCoreRange=null)]

6

7

2025-05-08 09:33:26.455 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

8

9

2025-05-08 09:33:26.461 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

10

11

2025-05-08 09:33:26.466 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

12

13

2025-05-08 09:33:26.474 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

14

15

2025-05-08 09:33:26.477 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

16

17

2025-05-08 09:33:46.480 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

18

19

2025-05-08 09:33:46.486 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

20

21

2025-05-08 09:33:46.491 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

22

23

2025-05-08 09:33:46.495 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

24

25

2025-05-08 09:33:46.498 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

26

27

2025-05-08 09:34:06.501 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

28

29

2025-05-08 09:34:06.506 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

30

31

2025-05-08 09:34:06.511 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

32

33

2025-05-08 09:34:06.516 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

34

35

2025-05-08 09:34:06.519 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

36

37

2025-05-08 09:34:26.522 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

38

39

2025-05-08 09:34:26.525 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

40

41

2025-05-08 09:34:26.531 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

42

43

2025-05-08 09:34:26.535 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

44

45

2025-05-08 09:34:26.539 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

46

47

2025-05-08 09:34:46.542 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

48

49

2025-05-08 09:34:46.548 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

50

51

2025-05-08 09:34:46.554 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

52

53

2025-05-08 09:34:46.557 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

54

55

2025-05-08 09:34:46.560 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

56

57

2025-05-08 09:35:06.563 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

58

59

2025-05-08 09:35:06.568 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

60

61

2025-05-08 09:35:06.573 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

62

63

2025-05-08 09:35:06.577 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

64

65

2025-05-08 09:35:06.580 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

66

67

2025-05-08 09:35:26.583 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : start to check server active

68

69

2025-05-08 09:35:26.586 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]

70

71

2025-05-08 09:35:26.591 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(status) AS status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS WHERE svr_ip = ? AND svr_port = ?, args: [192.168.180.31, 2882]

72

73

2025-05-08 09:35:26.594 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] c.o.o.s.t.b.server.ObServerTaskHandler : server 192.168.180.31, obServer=ObServer(svrIp=192.168.180.31, svrPort=2882, innerPort=2881, withRootserver=false, status=DELETING, zone=zone01, buildVersion=4.2.5.1_101000092024120918-6388bc0561faecba5f75a662c6e11c3dd0598de9(Dec 9 2024 18:57:58), stopTime=0, startServiceTime=0, blockMigrateInTime=0, id=null)

74

75

2025-05-08 09:35:26.597 INFO 2711978 — [manual-subtask-executor15,7307971fceff418e,7f7eb5a393928ed7] com.oceanbase.ocp.core.util.TaskUtils : [TaskUtils] wait 20 seconds

旭辉 · 2025 年5 月 8 日 09:40

麻烦发下OCP 版本，替换的observer所在OB集群的版本

以及当前集群的拓扑架构

旭辉 · 2025 年5 月 8 日 09:46

将整个任务日志下载发下，在任务界面右上角点击下载日志

都叫我浮云 · 2025 年5 月 8 日 09:48

在删除的节点在ZONE01，这个ZONE一共5台OBSERVER，OCP版本 4.3.3
OBSERVER版本 4.2.5

都叫我浮云 · 2025 年5 月 8 日 09:50

新用户无法上传附件

旭辉 · 2025 年5 月 8 日 09:51

没有这个限制的，你上传时报什么错

都叫我浮云 · 2025 年5 月 8 日 09:53

旭辉 · 2025 年5 月 8 日 09:57

不选“官方精选”再试试

都叫我浮云 · 2025 年5 月 8 日 09:59

问题反馈OBSERVER替换一直在等待删除状态这个是新帖子的链接，附件已经上传

都叫我浮云 · 2025 年5 月 8 日 10:03

好像还是不行

旭辉 · 2025 年5 月 8 日 10:05

选这个板块 “OceanBase 技术问题”

AntTech_OABMRM · 2025 年5 月 8 日 10:12

log_task_4005013 (1).zip (122.7 KB)

都叫我浮云 · 2025 年5 月 8 日 10:13

可能是我今天刚注册，有限制，这个板块也不行，我让我同事上传了，请看一下

旭辉 · 2025 年5 月 8 日 10:28

我确认了下，新用户注册是限制上传附件的，可以浏览10分钟，升级到1级用户就不会限制了

旭辉 · 2025 年5 月 8 日 10:29

查下这个发下结果

SELECT zone, svr_ip, svr_port, sql_port AS inner_port, with_rootserver, UPPER(`status`) AS `status`, build_version, UNIX_TIMESTAMP(NVL(`stop_time`, 0))*1000000 AS stop_time, UNIX_TIMESTAMP(NVL(`start_service_time`, 0))*1000000 AS start_service_time, UNIX_TIMESTAMP(NVL(`block_migrate_in_time`, 0))*1000000 AS block_migrate_in_time FROM DBA_OB_SERVERS;

都叫我浮云 · 2025 年5 月 8 日 11:28

OCEANBASE日志.txt (4.2 KB)
请见日志，老节点192.168.180.31，新节点192.168.180.51，从状态上来看，老节点还在DELETING状态，新节点是ACTIVE，ZONE01里的OBSERVER数量从原先的5台变成6台了

旭辉 · 2025 年5 月 8 日 14:10

查询下

select * from __all_server where svr_ip = '$DELETE_SERVER_IP';  --替换为待删除的observer ip

select * from __all_rootservice_job where job_type = 'DELETE_SERVER';

select tenant_id,count(1) from __all_virtual_meta_table where svr_ip = 'xxx.xxx.xxx.xxx' group by 1;  --替换为待删除的observer ip

select * from __all_unit where svr_ip = 'xxx.xxx.xxx.xxx'; --替换为待删除的observer ip