新部署OCP无法接管老OCP中OBProxy

[方大怂]

【 使用环境 】测试环境
【 OB or 其他组件 】OCP OBProxy
【 使用版本 】OCP 4.3.2
【问题描述】新部署OCP无法接管老OCP的OBProxy
【复现路径】无法接管，报OBProxy 无法连接，请确认 OBProxy 是否正常运行或者 root@proxysys 密码是否正确

[旭辉]

麻烦发下obproxy的版本
以及包含报错时段的ocp-server.log

[try_again]

鼠标放在"检查结果"下方的"原因"，看下是否显示具体原因

[方大怂]

OBProxy 无法连接，请确认 OBProxy 是否正常运行或者 root@proxysys 密码是否正确

[try_again]

1、obproxy服务器上执行 ps -ef |grep obproxy
检查obproxy服务是否正常
2、 obclient -h<OBProxy_IP> -P2883 -uroot@proxysys -p’<密码>’
如果登陆失败可能是密码错误

[方大怂]

老OBProxy：4.2.1.0-11
新OBProxy：4.3.1.0

2025-03-13 14:42:31.576 INFO 36804 — [ocp-async-1,025cf8957c085279,4058e2aa43f3eae0] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents
2025-03-13 14:42:32.041 INFO 36804 — [ocp-schedules-19,1cbea0abd3cd57a0,b0353755981916ff] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info
2025-03-13 14:42:32.044 INFO 36804 — [ocp-schedules-19,1cbea0abd3cd57a0,b0353755981916ff] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Invalidate clusters [] cache info success.
2025-03-13 14:42:32.044 INFO 36804 — [ocp-schedules-19,1cbea0abd3cd57a0,b0353755981916ff] c.o.o.c.cache.ConfigServerCacheHolder : [ConfigServerCache]:Refresh all config server cache info success, cached size: 2
2025-03-13 14:42:32.498 INFO 36804 — [prometheus-minute-schedule-1,27b698567fccf240,7bb5f437e6660b1e] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1741848180, interval=60
2025-03-13 14:42:32.503 INFO 36804 — [prometheus-minute-schedule-1,27b698567fccf240,7bb5f437e6660b1e] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=6, collectTaskCount=6
2025-03-13 14:42:33.401 WARN 36804 — [ocp-async-1,2ef44b6988b2c7a3,32c8830eab0ef859] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty.
2025-03-13 14:42:33.576 INFO 36804 — [ocp-async-4,89d63739789fe479,a9b3f64d26fbce0f] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents
2025-03-13 14:42:33.625 INFO 36804 — [pool-11-thread-2,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.106.21.31:8080 refreshes policies…
2025-03-13 14:42:33.625 INFO 36804 — [pool-11-thread-2,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0
2025-03-13 14:42:34.474 INFO 36804 — [ocp-schedules-14,fa18d3b22a61c509,7c76d4624b453422] c.o.o.s.c.scheduled.TenantSchedules : Check all tenant service name conflict
2025-03-13 14:42:34.474 INFO 36804 — [ocp-schedules-14,fa18d3b22a61c509,7c76d4624b453422] .t.CheckAllTenantServiceNameConflictTask : Check all tenant service name conflict.
2025-03-13 14:42:34.857 INFO 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.o.o.s.c.c.s.utils.CsrfRequestMatcher : CSRF token required for API [POST /api/v2/obproxy/clusters/2/takeOverPreCheck, client 10.102.144.145, traceId 4e61d921a614b74f]
2025-03-13 14:42:34.860 INFO 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.o.o.s.c.trace.RequestTracingAspect : API: [POST /api/v2/obproxy/clusters/2/takeOverPreCheck?id=2, client=10.102.144.145, traceId=4e61d921a614b74f, method=IterableResponse com.oceanbase.ocp.server.common.controller.ObproxyController.takeOverPreCheck(Long,ObproxyTakeOverPreCheckParam), args=2,ObproxyTakeOverPreCheckParam(hostInfoList=[ObproxyTakeOverPreCheckHostParam(hostId=2, sqlPort=2883, exporterPort=null, rpcPort=null, proxysysPasswd=null)], lbInstanceList=[]),]
2025-03-13 14:42:34.874 INFO 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.o.o.s.o.SystemOdpOperatorFactory : connect obproxy 10.106.21.17 2883
2025-03-13 14:42:34.875 INFO 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] com.oceanbase.ocp.odpsdk.OdpOperator : [odpsdk] sql: SHOW proxyconfig, args: []
2025-03-13 14:42:34.878 WARN 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.oceanbase.ocp.odpsdk.OdpJdbcOperator : Failed to check odp connection Connection{driverClassName=com.oceanbase.jdbc.Driver, address=10.106.21.17, port=2883}, error is Failed to obtain JDBC Connection; nested exception is java.sql.SQLSyntaxErrorException: Could not connect to 10.106.21.17:2883 : (conn=104984) Access denied for user ‘root@proxysys’@‘10.106.21.31’ (using password: YES)
2025-03-13 14:42:34.879 INFO 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.o.o.s.c.trace.RequestTracingAspect : API OK: [POST /api/v2/obproxy/clusters/2/takeOverPreCheck client=10.102.144.145, traceId=4e61d921a614b74f, duration=25 ms]
2025-03-13 14:42:35.014 INFO 36804 — [ocp-schedules-19,f76a49b13137a054,7714bff080793876] c.o.o.s.c.scheduled.BinlogSchedules : Sync binlog clusters, size=0
2025-03-13 14:42:35.401 WARN 36804 — [ocp-async-4,938193666eb564e0,7edbd3dabf1f65c8] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty.
2025-03-13 14:42:35.402 INFO 36804 — [ocp-schedules-16,10961e00e2ab9d0b,798d971b2dba70e8] c.o.o.s.c.scheduled.TenantSchedules : Collect all tenant major compaction
2025-03-13 14:42:35.402 INFO 36804 — [ocp-schedules-16,10961e00e2ab9d0b,798d971b2dba70e8] o.s.t.b.t.CollectAllTenantCompactionTask : Begin to collect all tenants major compaction info
2025-03-13 14:42:35.419 INFO 36804 — [Collect all tenants major compactions2,10961e00e2ab9d0b,05d204a5e34009dc] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:ocpmetadb, tenant:ocp_monitor
2025-03-13 14:42:35.419 INFO 36804 — [Collect all tenants major compactions1,10961e00e2ab9d0b,2582afe0663e41a7] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:ocpmetadb, tenant:ocp_meta
2025-03-13 14:42:35.419 INFO 36804 — [Collect all tenants major compactions3,10961e00e2ab9d0b,43c40c5b2cdc367f] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:ocpmetadb, tenant:sys
2025-03-13 14:42:35.419 INFO 36804 — [Collect all tenants major compactions4,10961e00e2ab9d0b,6c5c5f6d9a27c232] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:uatob_yx, tenant:sys
2025-03-13 14:42:35.419 INFO 36804 — [Collect all tenants major compactions5,10961e00e2ab9d0b,91161f1c2e1d8d90] o.i.t.TenantCompactionCollectServiceImpl : Begin to collect major compaction info for cluster:uatob_yx, tenant:uatob_yx
2025-03-13 14:42:35.429 INFO 36804 — [Collect all tenants major compactions1,10961e00e2ab9d0b,2582afe0663e41a7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.430 INFO 36804 — [Collect all tenants major compactions4,10961e00e2ab9d0b,6c5c5f6d9a27c232] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.430 INFO 36804 — [Collect all tenants major compactions2,10961e00e2ab9d0b,05d204a5e34009dc] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.430 INFO 36804 — [Collect all tenants major compactions5,10961e00e2ab9d0b,91161f1c2e1d8d90] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.430 INFO 36804 — [Collect all tenants major compactions3,10961e00e2ab9d0b,43c40c5b2cdc367f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.430 INFO 36804 — [Collect all tenants major compactions1,10961e00e2ab9d0b,2582afe0663e41a7] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002]
2025-03-13 14:42:35.431 INFO 36804 — [Collect all tenants major compactions2,10961e00e2ab9d0b,05d204a5e34009dc] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1004]
2025-03-13 14:42:35.432 INFO 36804 — [Collect all tenants major compactions5,10961e00e2ab9d0b,91161f1c2e1d8d90] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1002]
2025-03-13 14:42:35.432 INFO 36804 — [Collect all tenants major compactions4,10961e00e2ab9d0b,6c5c5f6d9a27c232] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1]
2025-03-13 14:42:35.433 INFO 36804 — [Collect all tenants major compactions3,10961e00e2ab9d0b,43c40c5b2cdc367f] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT tenant_id, global_broadcast_scn AS broadcast_scn, is_error AS error, status, frozen_scn, last_scn, is_suspended AS suspend, info, start_time, last_finish_time FROM CDB_OB_MAJOR_COMPACTION WHERE tenant_id = ?, args: [1]
2025-03-13 14:42:35.433 INFO 36804 — [Collect all tenants major compactions1,10961e00e2ab9d0b,2582afe0663e41a7] o.i.t.TenantCompactionCollectServiceImpl : current compaction frozen scn:1741802404449183757, broadcast scn:1741802404449183757, saved frozen scn:1741802404449183757
2025-03-13 14:42:35.433 INFO 36804 — [Collect all tenants major compactions1,10961e00e2ab9d0b,2582afe0663e41a7] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:ocpmetadb, tenant:ocp_meta
2025-03-13 14:42:35.434 INFO 36804 — [Collect all tenants major compactions2,10961e00e2ab9d0b,05d204a5e34009dc] o.i.t.TenantCompactionCollectServiceImpl : current compaction frozen scn:1741802404132137466, broadcast scn:1741802404132137466, saved frozen scn:1741802404132137466
2025-03-13 14:42:35.434 INFO 36804 — [Collect all tenants major compactions2,10961e00e2ab9d0b,05d204a5e34009dc] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:ocpmetadb, tenant:ocp_monitor
2025-03-13 14:42:35.435 INFO 36804 — [Collect all tenants major compactions3,10961e00e2ab9d0b,43c40c5b2cdc367f] o.i.t.TenantCompactionCollectServiceImpl : current compaction frozen scn:1741802404855765464, broadcast scn:1741802404855765464, saved frozen scn:1741802404855765464
2025-03-13 14:42:35.435 INFO 36804 — [Collect all tenants major compactions3,10961e00e2ab9d0b,43c40c5b2cdc367f] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:ocpmetadb, tenant:sys
2025-03-13 14:42:35.436 INFO 36804 — [Collect all tenants major compactions5,10961e00e2ab9d0b,91161f1c2e1d8d90] o.i.t.TenantCompactionCollectServiceImpl : current compaction frozen scn:1741802404122983000, broadcast scn:1741802404122983000, saved frozen scn:1741802404122983000
2025-03-13 14:42:35.437 INFO 36804 — [Collect all tenants major compactions5,10961e00e2ab9d0b,91161f1c2e1d8d90] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:uatob_yx, tenant:uatob_yx
2025-03-13 14:42:35.438 INFO 36804 — [Collect all tenants major compactions4,10961e00e2ab9d0b,6c5c5f6d9a27c232] o.i.t.TenantCompactionCollectServiceImpl : current compaction frozen scn:1741802404315691000, broadcast scn:1741802404315691000, saved frozen scn:1741802404315691000
2025-03-13 14:42:35.439 INFO 36804 — [Collect all tenants major compactions4,10961e00e2ab9d0b,6c5c5f6d9a27c232] o.i.t.TenantCompactionCollectServiceImpl : Finish to collect major compaction info for cluster:uatob_yx, tenant:sys
2025-03-13 14:42:35.439 INFO 36804 — [ocp-schedules-16,10961e00e2ab9d0b,798d971b2dba70e8] o.s.t.b.t.CollectAllTenantCompactionTask : Finish to collect all tenants major compaction info
2025-03-13 14:42:35.498 INFO 36804 — [prometheus-minute-schedule-1,ceed71d067ae90d5,dd8576b80636e03d] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1741848180, interval=60
2025-03-13 14:42:35.502 INFO 36804 — [prometheus-minute-schedule-1,ceed71d067ae90d5,dd8576b80636e03d] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=6, collectTaskCount=6
2025-03-13 14:42:35.576 INFO 36804 — [ocp-async-2,574501662d64abaf,de92f10c66932ca9] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents
2025-03-13 14:42:35.650 INFO 36804 — [ocp-schedules-29,e8a7fc1423df5ceb,15cbac4ab37437e3] .o.o.s.t.b.c.AbstractShardingClusterTask : Sync all clusters executed completed, allCount=2, successCount=2
2025-03-13 14:42:35.650 INFO 36804 — [ocp-schedules-29,d977e96037a1bbc3,23e2a9dd28e8fa77] c.o.o.s.c.scheduled.ClusterSchedules : Sync cluster info schedule.
2025-03-13 14:42:35.652 INFO 36804 — [ocp-schedules-29,d977e96037a1bbc3,23e2a9dd28e8fa77] .o.o.s.t.b.c.AbstractShardingClusterTask : Consume clusters: [1, 2]
2025-03-13 14:42:35.677 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.677 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.678 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, status, region, idc FROM DBA_OB_ZONES
2025-03-13 14:42:35.678 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, status, region, idc FROM DBA_OB_ZONES
2025-03-13 14:42:35.699 INFO 36804 — [Sync all clusters1,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=ocpmetadb, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.699 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.700 INFO 36804 — [Sync all clusters2,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=uatob_yx, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.700 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = ‘cluster’ AND name LIKE ? , args: [cluster]
2025-03-13 14:42:35.701 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.701 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SHOW PARAMETERS WHERE scope = ‘cluster’ AND name LIKE ? , args: [cluster]
2025-03-13 14:42:35.726 INFO 36804 — [Sync all clusters1,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=ocpmetadb, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.727 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.727 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, status, region, idc FROM DBA_OB_ZONES
2025-03-13 14:42:35.728 WARN 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] idcName is empty, zoneName=zone1
2025-03-13 14:42:35.728 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.731 INFO 36804 — [Sync all clusters2,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=uatob_yx, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.732 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(status) as status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC
2025-03-13 14:42:35.732 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.733 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}
2025-03-13 14:42:35.733 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, status, region, idc FROM DBA_OB_ZONES
2025-03-13 14:42:35.735 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.739 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT zone, svr_ip, svr_port, sql_port as inner_port, with_rootserver, UPPER(status) as status, build_version, UNIX_TIMESTAMP(NVL(stop_time, 0))*1000000 as stop_time, UNIX_TIMESTAMP(NVL(start_service_time, 0))*1000000 as start_service_time, UNIX_TIMESTAMP(NVL(block_migrate_in_time, 0))*1000000 as block_migrate_in_time, id FROM DBA_OB_SERVERS ORDER BY zone ASC, id ASC
2025-03-13 14:42:35.740 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=1, name=zone1, idcId=1, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING
2025-03-13 14:42:35.740 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=1, ip=10.106.21.31, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/data/admin/oceanbase, runUser=admin, version=4.2.1.8_108000022024072217-3149c25ca2dadbb7707686ad02a1367b1b43e0b5(Jul 23 2024 02:01:58), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2025-03-12T10:52:24+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=10.106.21.31, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.2.1.8_108000022024072217-3149c25ca2dadbb7707686ad02a1367b1b43e0b5(Jul 23 2024 02:01:58), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2025-03-12T10:52:24.397434+08:00, stopTime=1970-01-01T08:00+08:00}
2025-03-13 14:42:35.740 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605203] detect zone changed, before=ObZoneEntity{id=2, name=zone1, idcId=2, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, current=ObZoneEntity{id=null, name=zone1, idcId=2, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}
2025-03-13 14:42:35.748 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=1, ip=10.106.21.31, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/data/admin/oceanbase, runUser=admin, version=4.2.1.8_108000022024072217-3149c25ca2dadbb7707686ad02a1367b1b43e0b5(Jul 23 2024 02:01:58), withRootserver=true, hostId=1, status=RUNNING, innerStatus=ACTIVE, startTime=2025-03-12T10:52:24.397434+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING
2025-03-13 14:42:35.748 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] zone updated, zone=ObZoneEntity{id=2, name=zone1, idcId=2, status=RUNNING, innerStatus=ACTIVE, compactionStatus=null, startTime=null, stopTime=null}, oldStatus=RUNNING, newStatus=RUNNING
2025-03-13 14:42:35.748 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605303] detect server changed, before=ObServerEntity{id=2, ip=10.106.21.17, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.3.1_101000012024102216-2df04a2a7a203b498f23e1904d4b7a000457ce43(Oct 22 2024 17:46:45), withRootserver=true, hostId=2, status=RUNNING, innerStatus=ACTIVE, startTime=2024-10-31T14:24:36+08:00, stopTime=1970-01-01T08:00+08:00}, current=ObServerEntity{id=null, ip=10.106.21.17, port=2882, sqlPort=2881, installPath=null, runPath=null, runUser=null, version=4.3.3.1_101000012024102216-2df04a2a7a203b498f23e1904d4b7a000457ce43(Oct 22 2024 17:46:45), withRootserver=true, hostId=2, status=RUNNING, innerStatus=ACTIVE, startTime=2024-10-31T14:24:36.064100+08:00, stopTime=1970-01-01T08:00+08:00}
2025-03-13 14:42:35.755 INFO 36804 — [Sync all clusters1,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=ocpmetadb, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.755 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.756 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = ‘min_observer_version’
2025-03-13 14:42:35.756 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] server updated, server=ObServerEntity{id=2, ip=10.106.21.17, port=2882, sqlPort=2881, installPath=/home/admin/oceanbase, runPath=/home/admin/oceanbase, runUser=admin, version=4.3.3.1_101000012024102216-2df04a2a7a203b498f23e1904d4b7a000457ce43(Oct 22 2024 17:46:45), withRootserver=true, hostId=2, status=RUNNING, innerStatus=ACTIVE, startTime=2024-10-31T14:24:36.064100+08:00, stopTime=1970-01-01T08:00+08:00}, oldStatus=RUNNING, newStatus=RUNNING
2025-03-13 14:42:35.757 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster ocpmetadb
2025-03-13 14:42:35.760 INFO 36804 — [Sync all clusters1,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 1, sqlPort: 2881
2025-03-13 14:42:35.763 INFO 36804 — [Sync all clusters1,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=1
2025-03-13 14:42:35.764 INFO 36804 — [Sync all clusters2,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=uatob_yx, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.764 INFO 36804 — [Sync all clusters1,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 1
2025-03-13 14:42:35.765 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.766 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: select max(value) value from oceanbase.__all_virtual_sys_parameter_stat where name = ‘min_observer_version’
2025-03-13 14:42:35.767 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : Update cluster attributes info of cluster uatob_yx
2025-03-13 14:42:35.771 INFO 36804 — [Sync all clusters2,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 2, sqlPort: 2881
2025-03-13 14:42:35.774 INFO 36804 — [Sync all clusters2,] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2
2025-03-13 14:42:35.776 INFO 36804 — [Sync all clusters2,] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 2
2025-03-13 14:42:35.778 INFO 36804 — [Sync all clusters1,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://10.106.21.31:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null
2025-03-13 14:42:35.790 INFO 36804 — [Sync all clusters2,] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://10.106.21.17:62888/api/v1/ob/getProcessInfo, request body:ObproxyProcessInfoRequest(sqlPort=2881), params:null
2025-03-13 14:42:35.929 INFO 36804 — [Sync all clusters1,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 1, sqlPort: 2881 got ObProcessInfoResult(pid=32501, runPath=/data/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase)
2025-03-13 14:42:35.938 INFO 36804 — [Sync all clusters1,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=ocpmetadb, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:35.939 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:35.939 INFO 36804 — [Sync all clusters1,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE
2025-03-13 14:42:35.948 INFO 36804 — [Sync all clusters1,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=1, clusterName=ocpmetadb, obClusterId=1741747808
2025-03-13 14:42:35.948 INFO 36804 — [Sync all clusters1,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=1, name=ocpmetadb, obClusterId=1741747808, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson={“ObCluster”:“ocpmetadb”,“ObClusterId”:1741747808,“ObRegion”:“ocpmetadb”,“ObRegionId”:1741747808,“ReadonlyRsList”:[],“RsList”:[{“address”:“10.106.21.31:2882”,“role”:“LEADER”,“sql_port”:2881}],“Type”:“PRIMARY”,“timestamp”:1741848146061000}, createTime=2025-03-12T10:59:55+08:00, creator=admin, obVersion=4.2.1.8, packageOperatingSystem=null, loadType=null, tenantCount=3)
2025-03-13 14:42:36.048 INFO 36804 — [Sync all clusters2,] .o.o.i.c.ClusterHostOperationServiceImpl : get ob process info host: 2, sqlPort: 2881 got ObProcessInfoResult(pid=6753, runPath=/home/admin/oceanbase, runUser=admin, execute=/home/admin/oceanbase/bin/observer, installPath=/home/admin/oceanbase)
2025-03-13 14:42:36.059 INFO 36804 — [Sync all clusters2,] c.o.o.s.o.o.f.ConnectPropertiesBuilder : get credential from obsdk context, clusterName=uatob_yx, tenantName=sys, dbUser=ocp_monitor
2025-03-13 14:42:36.060 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: set ob_query_timeout = ?, args: [10000000]
2025-03-13 14:42:36.061 INFO 36804 — [Sync all clusters2,] c.o.ocp.obsdk.connector.ConnectTemplate : [obsdk] sql: SELECT arbitration_service_key, arbitration_service, previous_arbitration_service, type FROM DBA_OB_ARBITRATION_SERVICE
2025-03-13 14:42:36.072 INFO 36804 — [Sync all clusters2,] c.o.o.o.i.c.ClusterSyncServiceImpl : [OCP605] sync cluster done, clusterId=2, clusterName=uatob_yx, obClusterId=7
2025-03-13 14:42:36.072 INFO 36804 — [Sync all clusters2,] c.o.o.s.t.b.cluster.SyncAllClustersTask : [OCP605] cluster sync over, doSync=true, cluster=ObClusterOverview(id=2, name=uatob_yx, obClusterId=7, vpcId=1, vpcName=system-default, type=PRIMARY, status=RUNNING, origin=TAKEN_OVER, syncStatus=VALID, rootserverJson={“ObCluster”:“uatob_yx”,“ObClusterId”:7,“ObRegion”:“uatob_yx”,“ObRegionId”:7,“ReadonlyRsList”:[],“RsList”:[{“address”:“10.106.21.17:2882”,“role”:“LEADER”,“sql_port”:2881}],“Type”:“PRIMARY”,“timestamp”:1741848021651000}, createTime=2025-03-12T15:40:26+08:00, creator=admin, obVersion=4.3.3.1, packageOperatingSystem=null, loadType=null, tenantCount=2)
2025-03-13 14:42:36.107 INFO 36804 — [ocp-schedules-11,8ea56a3d646a219d,cdef4383b00f1cfe] .o.o.s.t.b.c.AbstractShardingClusterTask : Check all standby clusters sync delay time executed completed, allCount=2, successCount=2
2025-03-13 14:42:36.140 INFO 36804 — [ocp-schedules-20,c2c30e15b18556e6,8427ef9f47e94504] .o.o.s.t.b.c.AbstractShardingClusterTask : Check status for all clusters executed completed, allCount=2, successCount=2
2025-03-13 14:42:36.195 INFO 36804 — [alarm-task-1,b3a3c8c6cc14f4a5,a64bed7bbb2492cc] c.o.o.alarm.core.process.AlarmProcessor : process alarm start, currentTimestamp=2025-03-13T14:42:36.195161+08:00, lastProcessTime=2025-03-13T14:42:26.193254+08:00
2025-03-13 14:42:36.369 INFO 36804 — [alarm-task-1,b3a3c8c6cc14f4a5,a64bed7bbb2492cc] c.o.o.alarm.core.process.AlarmProcessor : process done, currentTimestamp=2025-03-13T14:42:36.195161+08:00
2025-03-13 14:42:36.626 INFO 36804 — [pool-11-thread-2,] c.o.o.s.i.r.s.RateLimitFacadeServiceImpl : 10.106.21.31:8080 refreshes policies…
2025-03-13 14:42:36.626 INFO 36804 — [pool-11-thread-2,] c.o.o.s.i.r.util.RateLimitCounter : After refresh, size of counterEntries :0
2025-03-13 14:42:37.401 WARN 36804 — [ocp-async-9,1528b0a64587e3ef,1b06dcbd2d12a322] c.o.o.a.s.AlarmInMemoryServiceImpl : aggregator or allDistributors is empty.
2025-03-13 14:42:37.576 INFO 36804 — [ocp-async-7,069d6cc847983a30,f2838a7cc9c5eafd] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSelfcure, method=observerAlarmEvents
2025-03-13 14:42:37.923 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.o.monitor.schedule.MonitorSchedules : measurementIdkey sync key id start.
2025-03-13 14:42:37.923 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=756343797434400768
2025-03-13 14:42:37.924 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.o.monitor.schedule.MonitorSchedules : recordIdKey sync key id start.
2025-03-13 14:42:37.924 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=756346817203257344
2025-03-13 14:42:37.924 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.o.monitor.schedule.MonitorSchedules : SeriesIdKey sync key id start.
2025-03-13 14:42:37.924 INFO 36804 — [ocp-schedules-25,35a66ddd48d65473,55fc3de4cba78a5b] c.o.ocp.monitor.service.IdKeyService : Sync key and id, currentMaxSeriesId=756685180540141568
2025-03-13 14:42:38.107 INFO 36804 — [ocp-async-2,09a8818dfa00c3ee,149caa0134ccfad5] c.o.o.s.common.DistributedLockAspect : Get distributed lock, lockKey=AlarmEventProcessForSnapshot, method=observerAlarmEvents
2025-03-13 14:42:38.498 INFO 36804 — [prometheus-minute-schedule-1,c40a361df64fd5d5,2610abbbc1d7cabd] c.o.ocp.monitor.OcpMonitorManager : Next exec sec=1741848180, interval=60
2025-03-13 14:42:38.502 INFO 36804 — [prometheus-minute-schedule-1,c40a361df64fd5d5,2610abbbc1d7cabd] c.o.ocp.monitor.OcpMonitorManager : Collect interval metrics, interval=60, exporterCount=6, collectTaskCount=6
^C

老密码忘记了

[方大怂]

老OBProxy是哪个地方是修改密码的

[旭辉]

老的obproxy如果没有修改过root@proxysys的密码，接管时就不需要修改，
是参考这个文档操作的接管吗？

https://www.oceanbase.com/docs/common-ocp-1000000002380845

[方大怂]

默认密码接管不了，

照这个图修改了老OBProxy和新OBProxy密码也接管不了

[方大怂]

页面改了密码去连接，也连接不上

[旭辉]

改密码后接管时这个开关要打开，如果还报错麻烦发下报错截图及点击原因发下

[try_again]

你好，黑屏用新密码可以连接旧的obproxy吗

[旭辉]

2025-03-13 14:42:34.878 WARN 36804 — [http-nio-0.0.0.0-8080-exec-7,4e61d921a614b74f,eef42ab4899f4a3f] c.oceanbase.ocp.odpsdk.OdpJdbcOperator : Failed to check odp connection Connection{driverClassName=com.oceanbase.jdbc.Driver, address=10.106.21.17, port=2883}, error is Failed to obtain JDBC Connection; nested exception is java.sql.SQLSyntaxErrorException: Could not connect to 10.106.21.17:2883 : (conn=104984) Access denied for user ‘root@proxysys’@‘10.106.21.31’ (using password: YES)

报错连接拒绝 root@proxysys@10.106.21.31，在ocp server上黑屏登陆这个试下

[方大怂]

[root@uatyxdb17 ~]# mysql -h10.106.21.17 -P2883 -uroot@proxysys -p’qq123321!’
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1045 (42000): Access denied for user ‘root@proxysys’@‘10.106.21.17’ (using password: NO)

页面改了密码，黑屏连接失败。

[方大怂]

[admin@uatywdb31 ~]$ mysql -h10.106.21.31 -P2883 -uroot@proxysys -p’qq123321!’
ERROR 1045 (42000): Access denied for user ‘root@proxysys’@‘10.106.21.31’ (using password: YES)

页面改了密码，黑屏登录失败。

[兰葩奇]

学习学习

[旭辉]

看起来是密码不对，发下obproxy.log，然后重启下obproxy再次登陆试下或者再 修改下root@proxysys密码，登陆试下

[方大怂]

2025-03-14 13:48:06.860 INFO 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.c.t.e.runner.JavaSubtaskRunner : Run subtask, id=11679340, context=Context{parallelIdx=-1, stringMap={former_obproxy_cluster_status=UNLOCK, subtask_splitter=obproxy_server_ids, target_obproxy_status=RUNNING, task_instance_id=10275189, target_operate_status=NORMAL, task_operation=execute, latest_execution_start_time=2025-03-14T13:48:06.828+08:00, sub_task_instance_name=Record obproxy info, sub_task_instance_id=11679340, obproxy_cluster_id=6, target_obproxy_cluster_status=UNLOCK}, listMap={obproxy_server_ids=[10], cluster_ids=[2000005]}}, executor=10.106.127.16

2

3

2025-03-14 13:48:06.886 INFO 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.s.o.SystemOdpOperatorFactory : connect obproxy 10.106.21.17 2883

4

5

2025-03-14 13:48:06.932 INFO 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.c.agent.HostAgentServiceImpl : Finding OCP agent: hostId=2000007

6

7

2025-03-14 13:48:06.935 INFO 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.c.a.p.HostAgentProcessServiceImpl : Getting all OCP agent processes on host 2000007

8

9

2025-03-14 13:48:06.994 INFO 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.e.internal.template.HttpTemplate : POST request to agent, url:http://10.106.21.17:62888/api/v1/process/info, request body:GetProcessInfoRequest(processName=obproxy, skipPorts=false), params:null

10

11

2025-03-14 13:48:07.000 ERROR 29947 — [pool-manual-subtask-executor16,b570eb0590344b55,e0c17ac75652] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : [AgentClient]:http request is failed, response:Authentication failed for wrong digest

12

13

com.oceanbase.ocp.executor.exception.HttpRequestFailedException: [AgentClient]:http request is failed, response:Authentication failed for wrong digest

14

at com.oceanbase.ocp.executor.internal.template.HttpTemplate.checkSuccess(HttpTemplate.java:476)

15

at com.oceanbase.ocp.executor.internal.template.HttpTemplate.doPost(HttpTemplate.java:286)

16

at com.oceanbase.ocp.executor.internal.template.HttpTemplate.post(HttpTemplate.java:114)

17

at com.oceanbase.ocp.executor.executor.AgentExecutor.getProcessInfoByName(AgentExecutor.java:262)

18

at com.oceanbase.ocp.obproxyops.internal.task.RecordObproxyInfoTask.run(RecordObproxyInfoTask.java:81)

19

at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64)

20

at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32)

21

at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26)

22

at com.oceanbase.ocp.core.task.engine.runner.RunnerFactory.doRun(RunnerFactory.java:76)

23

at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:203)

24

at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:197)

25

at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:134)

26

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

27

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

28

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

29

at java.lang.Thread.run(Thread.java:750)

30

31

32

Set state for subtask: 11679340, operation:EXECUTE, state: FAILED

33

重启失败

[方大怂]

编辑2ascasc.txt (74.7 KB)
obproxy.log

[方大怂]

OCP和OBProxy两个服务器之间是8080端口通的，其他端口不通