内存不够报错

OceanBase 技术问题
#1

obd demo
Get local repositories ok
Open ssh connection ok
Check for standby tenant ok
Search plugins ok
Cluster status check ok
obproxy work dir cleaning ok
grafana work dir cleaning ok
observer work dir cleaning ok
prometheus work dir cleaning ok
obagent work dir cleaning ok
demo destroyed
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
Cluster param config check ok
Open ssh connection ok
Generate grafana configuration ok
Generate obagent configuration ok
Generate prometheus configuration ok
Generate observer configuration ok
Generate obproxy configuration ok
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
±-------------------------------------------------------------------------------------------+
| Packages |
±-------------±--------±-----------------------±-----------------------------------------+
| Repository | Version | Release | Md5 |
±-------------±--------±-----------------------±-----------------------------------------+
| grafana | 7.5.17 | 1 | 1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 |
| obagent | 4.2.1 | 100000122023103020.el7 | c08058fef64b2dc6b5e2f99748fbd76fe872e356 |
| prometheus | 2.37.1 | 10000102022110211.el7 | 58913c7606f05feb01bc1c6410346e5fc31cf263 |
| oceanbase-ce | 4.2.1.1 | 101010012023111012.el7 | e98c6ef860b5644c36f806e6fa2265255572b40a |
| obproxy-ce | 4.2.1.0 | 11.el7 | 0aed4b782120e4248b749f67be3d2cc82cdcb70d |
±-------------±--------±-----------------------±-----------------------------------------+
Repository integrity check ok
Parameter check ok
Cluster status check ok
Initializes grafana work home ok
Initializes obagent work home ok
Initializes prometheus work home ok
Initializes observer work home ok
Initializes obproxy work home ok
Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository install ok
Remote grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 repository lib check ok
Remote obagent-4.2.1-100000122023103020.el7-c08058fef64b2dc6b5e2f99748fbd76fe872e356 repository install ok
Remote obagent-4.2.1-100000122023103020.el7-c08058fef64b2dc6b5e2f99748fbd76fe872e356 repository lib check ok
Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository install ok
Remote prometheus-2.37.1-10000102022110211.el7-58913c7606f05feb01bc1c6410346e5fc31cf263 repository lib check ok
Remote oceanbase-ce-4.2.1.1-101010012023111012.el7-e98c6ef860b5644c36f806e6fa2265255572b40a repository install ok
Remote oceanbase-ce-4.2.1.1-101010012023111012.el7-e98c6ef860b5644c36f806e6fa2265255572b40a repository lib check !!
Remote obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d repository install ok
Remote obproxy-ce-4.2.1.0-11.el7-0aed4b782120e4248b749f67be3d2cc82cdcb70d repository lib check ok
Try to get lib-repository
[WARN] Use centos 7 remote mirror repository for ubuntu 20.04
Remote oceanbase-ce-libs-4.2.1.1-101010012023111012.el7-411c69202b38e7e656ced7146b85c01414727149 repository install ok
Remote oceanbase-ce-4.2.1.1-101010012023111012.el7-e98c6ef860b5644c36f806e6fa2265255572b40a repository lib check ok
demo deployed
Get local repositories ok
Search plugins ok
Open ssh connection ok
Load cluster param plugin ok
Check before start observer x
[WARN] OBD-1011: (127.0.0.1) The recommended value of fs.aio-max-nr is 1048576 (Current value: 65536)
[WARN] (127.0.0.1) failed to get open files
[WARN] (127.0.0.1) failed to get max user processes
[ERROR] OBD-2000: (127.0.0.1) not enough memory. (Available: 2.6G, Need: 3.0G)
[WARN] OBD-1012: (127.0.0.1) clog and data use the same disk (/)

Check before start obproxy ok
Check before start obagent ok
Check before start prometheus ok
Check before start grafana ok
See OceanBase分布式数据库-海量数据 笔笔算数 .
Trace ID: ca13a190-9349-11ee-ac32-000c291499b3
If you want to view detailed obd logs, please run: obd display-trace ca13a190-9349-11ee-ac32-000c291499b3
image

#3

但是看起来内存总量没什么问题，和warring有关吗？

#4

执行这个命令，然后把输出的日志贴一下。 obd display-trace ca13a190-9349-11ee-ac32-000c291499b3

#5

obd display.docx (43.3 KB)

#6

free -h 看下内存 磁盘也看下吧df -Th
必要时可以清理下内存

#7

Filesystem Type Size Used Avail Use% Mounted on
udev devtmpfs 1.9G 0 1.9G 0% /dev
tmpfs tmpfs 388M 1.8M 386M 1% /run
/dev/sda5 ext4 39G 13G 25G 34% /
tmpfs tmpfs 1.9G 0 1.9G 0% /dev/shm
tmpfs tmpfs 5.0M 4.0K 5.0M 1% /run/lock
tmpfs tmpfs 1.9G 0 1.9G 0% /sys/fs/cgroup
/dev/loop0 squashfs 64M 64M 0 100% /snap/core20/1828
/dev/loop1 squashfs 128K 128K 0 100% /snap/bare/5
/dev/loop2 squashfs 64M 64M 0 100% /snap/core20/2015
/dev/loop3 squashfs 74M 74M 0 100% /snap/core22/864
/dev/loop4 squashfs 347M 347M 0 100% /snap/gnome-3-38-2004/119
/dev/loop5 squashfs 350M 350M 0 100% /snap/gnome-3-38-2004/143
/dev/loop7 squashfs 92M 92M 0 100% /snap/gtk-common-themes/1535
/dev/loop6 squashfs 497M 497M 0 100% /snap/gnome-42-2204/141
/dev/loop8 squashfs 13M 13M 0 100% /snap/snap-store/959
/dev/loop10 squashfs 50M 50M 0 100% /snap/snapd/18357
/dev/loop9 squashfs 46M 46M 0 100% /snap/snap-store/638
/dev/loop11 squashfs 41M 41M 0 100% /snap/snapd/20290
/dev/sda1 vfat 511M 4.0K 511M 1% /boot/efi
tmpfs tmpfs 388M 20K 388M 1% /run/user/1000

#8

ree -h
total used free shared buff/cache available
Mem: 3.8Gi 887Mi 2.2Gi 26Mi 759Mi 2.7Gi
Swap: 923Mi 0B 923Mi

#9

image
image1010×986 255 KB

这里看出是可用内存不足。 obd 检查的内存是可用的 非缓存的，你可以清理一下缓存
echo 1 > /proc/sys/vm/drop_caches

#10

谢谢，解决了

#11

好的