observe报错

【 使用环境 】生产环境 or 测试环境
【 OB or 其他组件 】
【 使用版本 】
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【问题现象及影响】
[root@obs1 log]# tail -n 2000 -f observer.log |grep ERROR
[2023-07-21 09:33:03.784450] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=14][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:09.662327] ERROR issue_dba_error (ob_log.cpp:1792) [17288][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:13.218660] ERROR issue_dba_error (ob_log.cpp:1792) [16310][T1_ReplaySrv6][T1][Y0-0000000000000000-0-0] [lt=37][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:14.746534] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:25.330964] ERROR issue_dba_error (ob_log.cpp:1792) [17288][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:36.556111] ERROR issue_dba_error (ob_log.cpp:1792) [16311][T1_ReplaySrv7][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:36.871364] ERROR issue_dba_error (ob_log.cpp:1792) [16310][T1_ReplaySrv6][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:45.547550] ERROR issue_dba_error (ob_log.cpp:1792) [16308][T1_ReplaySrv4][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:46.047845] ERROR issue_dba_error (ob_log.cpp:1792) [17289][T1002_ReplaySrv][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:50.572602] ERROR issue_dba_error (ob_log.cpp:1792) [16308][T1_ReplaySrv4][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:51.802985] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:54.628084] ERROR issue_dba_error (ob_log.cpp:1792) [16309][T1_ReplaySrv5][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:55.967074] ERROR issue_dba_error (ob_log.cpp:1792) [16309][T1_ReplaySrv5][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:56.067207] ERROR issue_dba_error (ob_log.cpp:1792) [16311][T1_ReplaySrv7][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:56.426050] ERROR issue_dba_error (ob_log.cpp:1792) [16310][T1_ReplaySrv6][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:33:59.237250] ERROR issue_dba_error (ob_log.cpp:1792) [16306][T1_ReplaySrv2][T1][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:34:01.323737] ERROR issue_dba_error (ob_log.cpp:1792) [16307][T1_ReplaySrv3][T1][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:34:01.782597] ERROR issue_dba_error (ob_log.cpp:1792) [16305][T1_ReplaySrv1][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)
[2023-07-21 09:34:04.362283] ERROR issue_dba_error (ob_log.cpp:1792) [16308][T1_ReplaySrv4][T1][Y0-0000000000000000-0-0] [lt=9][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=0, file=“palf_iterator.h”, line_no=252, info=“invliad data or checksum error!!!”)

【附件】

这个场景和这个task有点像，看下是否是同类型的问题，对应task时存储设备本身存在的问题，内有相关的测试代码用来进行独立测试

dell的 PERC H755N

task内有HaHaJeff 提供的单测程序，可以进行测试下是否是存储硬件是否存在异常

task在哪个路径呀我没找到
drwxr-xr-x. 12 root root 173 Jul 4 17:40 obagent
drwxr-xr-x. 12 root root 137 Jul 4 17:38 oceanbase
[root@obs1 obs]# pwd
/home/oceanbase/obs

[root@obs1 repository]# ll
total 0
drwxr-xr-x. 3 root root 19 Jul 4 17:38 obagent
drwxr-xr-x. 3 root root 21 Jul 4 17:37 oceanbase-ce
drwxr-xr-x. 3 root root 21 Jul 4 17:38 oceanbase-ce-libs

这个task是指上面的链接

image1019×457 64 KB

[root@obs1 data]# ll
total 0
lrwxrwxrwx. 1 root root 24 Jul 4 17:36 clog → /home/oceanbase/log/clog
drwxr-xr-x. 6 root root 74 Jul 4 17:39 slog
drwxr-xr-x. 2 root root 24 Jul 4 17:38 sstable
我没有截图中的redlog目录 我放在
total 164
drwxr–r–. 2 root root 98304 Jul 21 10:55 log_pool
drwxr-xr-x. 3 root root 15 Jul 4 17:38 tenant_1
drwxr-xr-x. 3 root root 15 Jul 4 17:40 tenant_1001
drwxr-xr-x. 6 root root 51 Jul 4 17:40 tenant_1002
[root@obs1 clog]# pwd
/home/oceanbase/data/clog这个下可以么

同一问题就不要多开了吧，都合并到这一个吧，后续本task不再回复