内存一直不释放,租户内存100%

【 使用环境 】生产环境 or 测试环境
【 OB or 其他组件 】
【 使用版本 】4.3.4
【问题描述】清晰明确描述问题
内存一直不释放,分配的越多,用的越多,一直报-4013
[2025-06-05 13:59:01.027973] WDIAG [COMMON] alloc (ob_io_struct.cpp:315) [3793][T1004_ArcSender][T1004][YB42C0A800AF-00063628FBCBA661-0-0] [lt=16][errcode=-4013] failed to allocate io mem block(ret=-4013, size=67108864)

OceanBase 社区已接收您的帖子,正在跟进中。

带宽信息查看
obclient [(none)]> select * from oceanbase.GV$ob_shared_storage_quota;

±--------------±---------±---------±--------------------------------------------------------------------±---------±-----±------------±--------------------+

| SVR_IP | SVR_PORT | ENDPOINT | PATH | CLASS_ID | TYPE | REQUIREMENT | ASSIGN |

±--------------±---------±---------±--------------------------------------------------------------------±---------±-----±------------±--------------------+

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/admin/myoceanbase/oceanbase/backup_clog | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-01-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-10-13-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-02-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-11-26-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-29-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-03-17-09-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-30-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-06-04-17-09-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-31-13-31-01 | 1004 | tag | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | ops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | ips | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | iops | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | obw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | ibw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | iobw | 0 | 9223372036854775807 |

| 192.168.0.175 | 2882 | | file:///home/hyzn/data_backup/mysql_data_backup/2025-05-27-10-13-01 | 1004 | tag | 0 | 9223372036854775807 |

±--------------±---------±---------±--------------------------------------------------------------------±---------±-----±------------±--------------------+
用户开了归档,归档使用的是本地盘;ob使用的是机械盘
非内存泄漏,用户用本地盘做日志归档,理论上不应该受网卡带宽的qos影响。但是ob内部目前没法确定日志归档的介质是nfs还是本地盘,导致被限流了。
处理方法:
observer目录下执行:echo “eth0=10G” > etc/nic.rate.config