ocp告警记录
observer总是挂掉,相关日志
Analyze OceanBase Online Log Summary:
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| Node | Status | FileName | First Found Time | ErrorCode | Message | Count |
+==============+===========+==========================================================================================================+============================+=============+================+=========+
| 192.168.2.93 | Completed | /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222060222571 | 2025-02-22 05:51:44.650294 | -4016 | Internal error | 29 |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| 192.168.2.93 | Completed | /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222061333114 | 2025-02-22 06:02:53.287754 | -4016 | Internal error | 24 |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| 192.168.2.93 | Completed | /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222062431563 | 2025-02-22 06:13:47.435372 | -4016 | Internal error | 26 |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| 192.168.2.93 | Completed | /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222063201760 | 2025-02-22 06:24:57.542852 | -4016 | Internal error | 12 |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| 192.168.2.94 | PASS | | | | | |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
| 192.168.2.99 | Completed | /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.99/observer.log.20250222064615838 | 2025-02-22 06:22:16.110967 | -4016 | Internal error | 35 |
±-------------±----------±---------------------------------------------------------------------------------------------------------±---------------------------±------------±---------------±--------+
Details:
Node: 192.168.2.93
Status: Completed
FileName: /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222060222571
First Found Time: 2025-02-22 05:51:44.650294
ErrorCode: -4016
Message: Internal error
Count: 29
Last Found Time: 2025-02-22 06:01:18.567820
Cause: Internal Error
Solution: Contact OceanBase Support
Trace_IDS: [‘B42C0A8025D-00062E7487AFE7A7-0-0’, ‘B42C0A8025D-00062E74CCAED312-0-0’, ‘B42C0A8025D-00062E7487AFEA83-0-0’, ‘B42C0A8025D-00062E7487AFEB9A-0-0’, ‘B42C0A8025D-00062E7487AFEDA9-0-0’, ‘B42C0A8025D-00062E7487AFF190-0-0’, ‘B42C0A8025D-00062E7487AFF9ED-0-0’, ‘B42C0A8025D-00062E7487AFFF33-0-0’, ‘B42C0A8025D-00062E7819C1E9FE-0-0’, ‘B42C0A8025D-00062E223BA41C62-0-0’, ‘B42C0A8025D-00062E74CCAEECD9-0-0’, ‘B42C0A8025D-00062E7819C1EEE3-0-0’, ‘B42C0A8025D-00062E7819C1EEF0-0-0’, ‘B42C0A8025D-00062E74CCAEF548-0-0’, ‘B42C0A8025D-00062E700C5B3E79-0-0’, ‘B42C0A8025D-00062E74CCAEF93D-0-0’, ‘B42C0A8025D-00062E7819C1F949-0-0’, ‘B42C0A8025D-00062E700C5B3F2C-0-0’, ‘B42C0A8025D-00062E74CCAEFFD5-0-0’, ‘B42C0A8025D-00062E7819C20952-0-0’, ‘B42C0A8025D-00062E700C5B41F2-0-0’, ‘B42C0A8025D-00062E74CCAF141B-0-0’, ‘B42C0A8025D-00062E700C5B431E-0-0’, ‘B42C0A8025D-00062E7819C21BC8-0-0’, ‘B42C0A8025D-00062E65862DE329-0-0’, ‘B42C0A8025D-00062E7819C21FE6-0-0’, ‘B42C0A8025D-00062E7819C222FB-0-0’, ‘B42C0A8025D-00062E63D84719CC-0-0’, ‘B42C0A8025D-00062E74CCAF27CC-0-0’]
Node: 192.168.2.93
Status: Completed
FileName: /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222061333114
First Found Time: 2025-02-22 06:02:53.287754
ErrorCode: -4016
Message: Internal error
Count: 24
Last Found Time: 2025-02-22 06:13:29.796705
Cause: Internal Error
Solution: Contact OceanBase Support
Trace_IDS: [‘B42C0A8025D-00062E7819C2302E-0-0’, ‘B42C0A8025D-00062E74CCAF3B8E-0-0’, ‘B42C0A8025D-00062E74CCAF3D14-0-0’, ‘B42C0A8025D-00062E7819C23D5B-0-0’, ‘B42C0A8025D-00062E223A943790-0-0’, ‘B42C0A8025D-00062E74CCAF424F-0-0’, ‘B42C0A8025D-00062E7819C2428A-0-0’, ‘B42C0A8025D-00062E7819C24292-0-0’, ‘B42C0A8025D-00062E7819C24958-0-0’, ‘B42C0A8025D-00062E74CCAF5838-0-0’, ‘B42C0A8025D-00062E7819C2599D-0-0’, ‘B42C0A8025D-00062E7819C259A4-0-0’, ‘B42C0A8025D-00062E7819C271CC-0-0’, ‘B42C0A8025D-00062E7819C276BD-0-0’, ‘B42C0A8025D-00062E7819C27FCE-0-0’, ‘B42C0A8025D-00062E74CCAF86D2-0-0’, ‘B42C0A8025D-00062E74CCAF8B98-0-0’, ‘B42C0A8025D-00062E7819C28C8C-0-0’, ‘B42C0A8025D-00062E74CCAF8F92-0-0’, ‘B42C0A8025D-00062E7819C28DE1-0-0’, ‘B42C0A8025D-00062E7819C28FB2-0-0’, ‘B42C0A8025D-00062E74CCAF9227-0-0’, ‘B42C0A8025D-00062E74CCAF9311-0-0’, ‘B42C0A8025D-00062E7819C291AB-0-0’]
Node: 192.168.2.93
Status: Completed
FileName: /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222062431563
First Found Time: 2025-02-22 06:13:47.435372
ErrorCode: -4016
Message: Internal error
Count: 26
Last Found Time: 2025-02-22 06:23:47.694311
Cause: Internal Error
Solution: Contact OceanBase Support
Trace_IDS: [‘B42C0A8025D-00062E223A04AF2E-0-0’, ‘B42C0A8025D-00062E74CCAFA496-0-0’, ‘B42C0A8025D-00062E74CCAFA5D4-0-0’, ‘B42C0A8025D-00062E74CCAFA6A1-0-0’, ‘B42C0A8025D-00062E7819C2A586-0-0’, ‘B42C0A8025D-00062E74CCAFAFDE-0-0’, ‘B42C0A8025D-00062E7819C2AD24-0-0’, ‘B42C0A8025D-00062E7819C2AD4B-0-0’, ‘B42C0A8025D-00062E7819C2BAE5-0-0’, ‘B42C0A8025D-00062E7819C2C154-0-0’, ‘B42C0A8025D-00062E74CCAFC387-0-0’, ‘B42C0A8025D-00062E74CCAFC7B3-0-0’, ‘B42C0A8025D-00062E7819C2C580-0-0’, ‘B42C0A8025D-00062E74CCAFC7C1-0-0’, ‘B42C0A8025D-00062E74CCAFD297-0-0’, ‘B42C0A8025D-00062E7819C2D517-0-0’, ‘B42C0A8025D-00062E7819C2D6DC-0-0’, ‘B42C0A8025D-00062E7819C2D9C5-0-0’, ‘B42C0A8025D-00062E7819C2DC0C-0-0’, ‘B42C0A8025D-00062E7819C2DD04-0-0’, ‘B42C0A8025D-00062E7819C2E1B7-0-0’, ‘B42C0A8025D-00062E7819C2E646-0-0’, ‘B42C0A8025D-00062E7819C2EA98-0-0’, ‘B42C0A8025D-00062E74CCAFF642-0-0’, ‘B42C0A8025D-00062E7819C2F65B-0-0’, ‘B42C0A8025D-00062E7819C2F69B-0-0’]
Node: 192.168.2.93
Status: Completed
FileName: /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.93/observer.log.20250222063201760
First Found Time: 2025-02-22 06:24:57.542852
ErrorCode: -4016
Message: Internal error
Count: 12
Last Found Time: 2025-02-22 06:27:40.907567
Cause: Internal Error
Solution: Contact OceanBase Support
Trace_IDS: [‘B42C0A8025D-00062E785C81EB66-0-0’, ‘B42C0A8025D-00062E785C81F047-0-0’, ‘B42C0A8025D-00062E7819C308ED-0-0’, ‘B42C0A8025D-00062E700C5B6133-0-0’, ‘B42C0A8025D-00062E7819C30BAD-0-0’, ‘B42C0A8025D-00062E700C5B616F-0-0’, ‘B42C0A8025D-00062E7819C30BB2-0-0’, ‘B42C0A8025D-00062E223B842706-0-0’, ‘B42C0A8025D-00062E785C81FB40-0-0’, ‘B42C0A8025D-00062E785C81FD29-0-0’, ‘B42C0A8025D-00062E7819C31266-0-0’, ‘B42C0A8025D-00062E700C5B6421-0-0’]
Node: 192.168.2.94
Status: PASS
FileName: None
First Found Time: None
ErrorCode: None
Message: None
Count: None
Last Found Time: None
Cause: None
Solution: None
Trace_IDS: None
Node: 192.168.2.99
Status: Completed
FileName: /root/obdiag-3.1.0/obdiag_analyze_pack_20250222162413/remote_192.168.2.99/observer.log.20250222064615838
First Found Time: 2025-02-22 06:22:16.110967
ErrorCode: -4016
Message: Internal error
Count: 35
Last Found Time: 2025-02-22 06:27:43.386692
Cause: Internal Error
Solution: Contact OceanBase Support
Trace_IDS: [‘B42C0A80263-00062E6B6E4B09AA-0-0’, ‘B42C0A80263-00062E6BA4EA73A9-0-0’, ‘B42C0A80263-00062E6757CF4F3C-0-0’, ‘B42C0A80263-00062E6B6E4B0ACB-0-0’, ‘B42C0A80263-00062E6757CF4FFC-0-0’, ‘B42C0A80263-00062E69FBEAD2AD-0-0’, ‘B42C0A80263-00062E6A16ECD5F2-0-0’, ‘B42C0A80263-00062E6757CF5025-0-0’, ‘B42C0A80263-00062E69FBEAD2E7-0-0’, ‘B42C0A80263-00062E6B6E4B0F2C-0-0’, ‘B42C0A80263-00062E69FBEAD4EA-0-0’, ‘B42C0A80263-00062E25FF3BFC0C-0-0’, ‘B42C0A80263-00062E697DAF57E8-0-0’, ‘B42C0A80263-00062E6A16ECDE50-0-0’, ‘B42C0A80263-00062E697DAF5845-0-0’, ‘B42C0A80263-00062E26043B9890-0-0’, ‘B42C0A80263-00062E697DAF5862-0-0’, ‘B42C0A80263-00062E6AC3BA86F0-0-0’, ‘B42C0A80263-00062E6BA4EA7E29-0-0’, ‘B42C0A80263-00062E6B6E4B193B-0-0’, ‘B42C0A80263-00062E697DAF5A4F-0-0’, ‘B42C0A80263-00062E6BA4EA7EFF-0-0’, ‘B42C0A80263-00062E6A16ECE8D7-0-0’, ‘B42C0A80263-00062E6A16ECE8E5-0-0’, ‘B42C0A80263-00062E6B6E4B1CC0-0-0’, ‘B42C0A80263-00062E6A16ECEB25-0-0’, ‘B42C0A80263-00062E6A16ECEB2C-0-0’, ‘B42C0A80263-00062E6BA4EA8271-0-0’, ‘B42C0A80263-00062E638F0F2700-0-0’, ‘B42C0A80263-00062E6A16ECECA1-0-0’, ‘B42C0A80263-00062E6A16ECECA6-0-0’, ‘B42C0A80263-00062E6B6E4B1F05-0-0’, ‘B42C0A80263-00062E6757CF54C4-0-0’, ‘B42C0A80263-00062E6B6E4B216A-0-0’, ‘B42C0A80263-00062E6BA4EA8547-0-0’]
