ocp升级Oceanbase版本疑问

【 使用环境 】生产环境 or 测试环境
【 OB or 其他组件 】OCP和OB
【 使用版本 】ocp(版本号: 4.3.5-20250319105844)
OB从4.2.2.0升级到4.2.5.7
【问题描述】清晰明确描述问题
OB集群三个zone,每个zone一个节点,正常到升级步骤。
查看升级任务:
image
问题:
1、红色圆圈内的任务,一开始是失败的,报错信息如下,点击重试后就变成图片中的正常执行成功的状态了
026-03-04 17:09:08.198 ERROR 215527 — [manual-subtask-executor14,9200908bb43fa7e8,2130956ece09e967] c.o.o.c.t.e.c.w.subtask.SubtaskExecutor : No class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostServiceEntity entity with id 2000007 exists!

org.springframework.dao.EmptyResultDataAccessException: No class com.oceanbase.ocp.core.metadb.repo.compute.host.entity.HostServiceEntity entity with id 2000007 exists!
at org.springframework.data.jpa.repository.support.SimpleJpaRepository.lambda$deleteById$0(SimpleJpaRepository.java:173)
at java.util.Optional.orElseThrow(Optional.java:290)
at org.springframework.data.jpa.repository.support.SimpleJpaRepository.deleteById(SimpleJpaRepository.java:172)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.data.repository.core.support.RepositoryMethodInvoker$RepositoryFragmentMethodInvoker.lambda$new$0(RepositoryMethodInvoker.java:289)
at org.springframework.data.repository.core.support.RepositoryMethodInvoker.doInvoke(RepositoryMethodInvoker.java:137)
at org.springframework.data.repository.core.support.RepositoryMethodInvoker.invoke(RepositoryMethodInvoker.java:121)
at org.springframework.data.repository.core.support.RepositoryComposition$RepositoryFragments.invoke(RepositoryComposition.java:530)
at org.springframework.data.repository.core.support.RepositoryComposition.invoke(RepositoryComposition.java:286)
at org.springframework.data.repository.core.support.RepositoryFactorySupport$ImplementationMethodExecutionInterceptor.invoke(RepositoryFactorySupport.java:640)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.doInvoke(QueryExecutorMethodInterceptor.java
:164)
at org.springframework.data.repository.core.support.QueryExecutorMethodInterceptor.invoke(QueryExecutorMethodInterceptor.java:139)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.data.projection.DefaultMethodInvokingMethodInterceptor.invoke(DefaultMethodInvokingMethodInterceptor.java:81)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123)
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:137)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodInterceptor.invoke(CrudMethodMetadataPostProcessor.java:174)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:241)
at com.sun.proxy.$Proxy462.deleteById(Unknown Source)
at com.oceanbase.ocp.compute.host.manager.HostServiceManagerImpl.lambda$removeServiceFromHost$10(HostServiceManagerImpl.java:299)
at java.util.ArrayList.forEach(Arra
yList.java:1259)
at com.oceanbase.ocp.compute.host.manager.HostServiceManagerImpl.removeServiceFromHost(HostServiceManagerImpl.java:299)
at com.oceanbase.ocp.compute.host.manager.HostServiceManagerImpl$$FastClassBySpringCGLIB$$a449d072.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:792)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:123)
at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:388)
at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:119)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:762)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:707)
at com.oceanbase.ocp.compute.host.manager.HostServiceManagerImpl$$EnhancerBySpringCGLIB$$f9c087c0.removeServiceFromHost()
at com.oceanbase.ocp.service.task.business.host.ReserveHostTask.processForReserving(ReserveHostTask.java:82)
at com.oceanbase.ocp.service.task.business.host.ReserveHostTask.run(ReserveHostTask.java:54)
at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.execute(JavaSubtaskRunner.java:64)
at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.doRun(JavaSubtaskRunner.java:32)
at com.oceanbase.ocp.core.task.engine.runner.JavaSubtaskRunner.run(JavaSubtaskRunner.java:26)
at com.oceanbase.ocp.core.task.engine.runner.RunnerFac
tory.doRun(RunnerFactory.java:76)
at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.doRun(SubtaskExecutor.java:207)
at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.redirectConsoleOutput(SubtaskExecutor.java:201)
at com.oceanbase.ocp.core.task.engine.coordinator.worker.subtask.SubtaskExecutor.lambda$submit$2(SubtaskExecutor.java:137)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)

2、三个节点需要升级,正常是不是应该有三个Submit cluster upgrade task
和Wait dag success步骤,看任务里面只有两组。这个是不是和上面的报错呼应。

3、这是升级成功了还是没有升级成功?看着是升级成功了,但是比较疑惑第三个节点是什么时候升级的呢?
查看升级后的状态:


三个节点查看OB版本:
/home/obadmin/oceanbase/bin/observer -V
/home/obadmin/oceanbase/bin/observer -V
observer (OceanBase_CE 4.2.5.7)

REVISION: 107000022025120120-96355d7a296a4aeb80e5fd07dc6dc34aa8cdce8f
BUILD_BRANCH: HEAD
BUILD_TIME: Dec 1 2025 20:14:24
BUILD_FLAGS: RelWithDebInfo
BUILD_INFO:

Copyright (c) 2011-present OceanBase Inc.
@论坛小助手

2 个赞

根因分析场景: 未知问题
根因分析命令: 无
日志采集场景: 集群基础信息
日志采集命令: obdiag gather scene run --scene=observer.base

推荐使用 obdiag 工具进行日志采集,并且将采集到的日志提供给我们以便确认问题所在。上述命令将收集关于您的集群的基础信息,这对于我们分析升级过程中的问题非常有帮助。请运行该命令并上传生成的日志压缩包。

另外,为了确定具体的问题,在此需要您提供一些信息:

  1. 升级任务失败的具体错误信息是什么?
  2. 在重试成功的过程中,是否观察到了任何异常或警告?
  3. 三个节点中提交集群升级任务和等待DAG成功步骤不全的具体表现是什么?是否有具体的报错信息或日志记录?
  4. 最终升级成功后,各节点的状态如何?集群是否运行正常?
  5. 您是否有升级前后的配置文件对比,以便于我们查看是否存在配置上的差异?

以上信息将帮助我们更准确地定位问题。感谢您的配合!

附上敏捷诊断工具 obdiag 使用帮助链接

1 个赞

这个是OCP4.3.5版本的bug,在OCP4.3.6修复了,绕过方式就是重试,重试成功就是升级成功了。

2 个赞

建议升级下OCP版本到4.4.1

1 个赞

正常情况下都会重试成功吧,要是失败了,好像不支持回退

1 个赞

学习

是的,大概重试3次都能成功