OCP部署v4.2.1.8没有自动配置cgroup目录

情况概要

使用OCP 部署3节点OB集群,查看各个节点没有cgroup没有目录。

ll /home/admin/oceanbase/cgroup
ll /sys/fs/cgroup/cpu/oceanbase

但 教材中说OCP 会自动配置cgroup,查看参数也是true;

问题:

为什么没有相关目录?

使用OCP 社区版 安装OB 社区版,测试同样没有cgroup目录;

OCP版本

image

OB 版本

Welcome to the OceanBase.  Commands end with ; or \g.
Your OceanBase connection id is 3221542210
Server version: OceanBase_CE 4.2.1.8 (r108000022024072217-3149c25ca2dadbb7707686ad02a1367b1b43e0b5) (Built Jul 23 2024 02:01:58)

Copyright (c) 2000, 2018, OceanBase and/or its affiliates. All rights reserved.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

obclient(root@sys)[oceanbase]> select version();
+------------------------------+
| version()                    |
+------------------------------+
| 5.7.25-OceanBase_CE-v4.2.1.8 |
+------------------------------+
1 row in set (0.002 sec)

obclient(root@sys)[oceanbase]>

系统版本


[admin@rocky95 ~]$ cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.5 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.5"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.5 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
VENDOR_NAME="RESF"
VENDOR_URL="https://resf.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.5"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.5"
[admin@rocky95 ~]$ uname -r
5.14.0-503.14.1.el9_5.x86_64

OCP安装OB时 cgroup 开启

查看相关目录cgroup没有教材中的配置示例

[root@rocky95 cgroup]# ll /home/admin/oceanbase/cgroup
ls: cannot access '/home/admin/oceanbase/cgroup': No such file or directory
[root@rocky95 cgroup]# ll /home/admin/oceanbase/
total 16
drwxr-xr-x 2 root  root  4096 Jul 23  2024 admin
drwxr-xr-x 2 admin admin  109 Nov 13 16:57 audit
drwxr-xr-x 2 root  root   142 Nov 13 16:53 bin
drwxr-xr-x 2 admin admin 4096 Nov 13 17:11 etc
drwxr-xr-x 2 root  root   109 Jul 23  2024 lib
drwxr-xr-x 2 admin admin 4096 Nov 13 17:27 log
drwxr-xr-x 2 root  root  4096 Jul 23  2024 profile
drwxr-xr-x 2 admin admin   74 Nov 13 16:57 run
drwxr-xr-x 3 admin admin   23 Nov 13 16:53 store
drwxr-xr-x 2 admin admin    6 Nov 13 16:53 wallet
[root@rocky95 cgroup]# ll /sys/fs/cgroup/cpu/oceanbase
ls: cannot access '/sys/fs/cgroup/cpu/oceanbase': No such file or directory
[root@rocky95 cgroup]# ll /sys/fs/cgroup
total 0
-r--r--r--  1 root root 0 Nov 11 14:28 cgroup.controllers
-rw-r--r--  1 root root 0 Nov 13 17:28 cgroup.max.depth
-rw-r--r--  1 root root 0 Nov 13 17:28 cgroup.max.descendants
-rw-r--r--  1 root root 0 Nov 11 14:28 cgroup.procs
-r--r--r--  1 root root 0 Nov 13 17:28 cgroup.stat
-rw-r--r--  1 root root 0 Nov 13 16:13 cgroup.subtree_control
-rw-r--r--  1 root root 0 Nov 13 17:28 cgroup.threads
dr-xr-xr-x  2 root root 0 Nov 13 16:34 cpuset,cpu,cpuacct
-r--r--r--  1 root root 0 Nov 13 17:28 cpu.stat
-r--r--r--  1 root root 0 Nov 13 17:28 cpu.stat.local
drwxr-xr-x  2 root root 0 Nov 11 14:28 dev-hugepages.mount
drwxr-xr-x  2 root root 0 Nov 11 14:28 dev-mqueue.mount
drwxr-xr-x  2 root root 0 Nov 11 14:28 init.scope
-rw-r--r--  1 root root 0 Nov 13 17:28 io.cost.model
-rw-r--r--  1 root root 0 Nov 13 17:28 io.cost.qos
-r--r--r--  1 root root 0 Nov 13 17:28 io.stat
-r--r--r--  1 root root 0 Nov 13 17:28 memory.numa_stat
--w-------  1 root root 0 Nov 13 17:28 memory.reclaim
-r--r--r--  1 root root 0 Nov 13 17:28 memory.stat
-r--r--r--  1 root root 0 Nov 13 17:28 misc.capacity
-r--r--r--  1 root root 0 Nov 13 17:28 misc.current
drwxr-xr-x  2 root root 0 Nov 11 14:28 sys-fs-fuse-connections.mount
drwxr-xr-x  2 root root 0 Nov 11 14:28 sys-kernel-config.mount
drwxr-xr-x  2 root root 0 Nov 11 14:28 sys-kernel-debug.mount
drwxr-xr-x  2 root root 0 Nov 11 14:28 sys-kernel-tracing.mount
drwxr-xr-x 50 root root 0 Nov 13 17:28 system.slice
drwxr-xr-x  5 root root 0 Nov 13 16:13 user.slice
[root@rocky95 cgroup]#

mount挂载信息


[admin@rocky95 ~]$ mount
proc on /proc type proc (rw,nosuid,nodev,noexec,relatime)
sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime)
devtmpfs on /dev type devtmpfs (rw,nosuid,size=4096k,nr_inodes=8153011,mode=755,inode64)
securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime)
tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev,inode64)
devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000)
tmpfs on /run type tmpfs (rw,nosuid,nodev,size=13057924k,nr_inodes=819200,mode=755,inode64)
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime)
efivarfs on /sys/firmware/efi/efivars type efivarfs (rw,nosuid,nodev,noexec,relatime)
bpf on /sys/fs/bpf type bpf (rw,nosuid,nodev,noexec,relatime,mode=700)
/dev/mapper/rl-root on / type xfs (rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota)
systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20631)
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
mqueue on /dev/mqueue type mqueue (rw,nosuid,nodev,noexec,relatime)
debugfs on /sys/kernel/debug type debugfs (rw,nosuid,nodev,noexec,relatime)
tracefs on /sys/kernel/tracing type tracefs (rw,nosuid,nodev,noexec,relatime)
configfs on /sys/kernel/config type configfs (rw,nosuid,nodev,noexec,relatime)
fusectl on /sys/fs/fuse/connections type fusectl (rw,nosuid,nodev,noexec,relatime)
none on /run/credentials/systemd-sysctl.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
none on /run/credentials/systemd-tmpfiles-setup-dev.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
/dev/nvme0n1p2 on /boot type xfs (rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota)
/dev/nvme0n1p1 on /boot/efi type vfat (rw,relatime,fmask=0077,dmask=0077,codepage=437,iocharset=ascii,shortname=winnt,errors=remount-ro)
/dev/mapper/datavg-lvdata on /data type ext4 (rw,noatime,nodelalloc)
none on /run/credentials/systemd-tmpfiles-setup.service type ramfs (ro,nosuid,nodev,noexec,relatime,mode=700)
sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw,relatime)
tmpfs on /run/user/42 type tmpfs (rw,nosuid,nodev,relatime,size=6528960k,nr_inodes=1632240,mode=700,uid=42,gid=42,inode64)
tmpfs on /run/user/0 type tmpfs (rw,nosuid,nodev,relatime,size=6528960k,nr_inodes=1632240,mode=700,inode64)
tmpfs on /run/user/1001 type tmpfs (rw,nosuid,nodev,relatime,size=6528960k,nr_inodes=1632240,mode=700,uid=1001,gid=1001,inode64)
cgroup on /sys/fs/cgroup/cpuset,cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset,cpu,cpuacct)

OCP是什么版本?

OCP V4.3.5 企业版

社区版默认是自动开启cgroup的,你这里看也是开启的,但是开启的应该有问题,企业版建议联系相应商务支持

1 个赞

为了全面学习产品特性,特地卸载了社区版重装企业版,还没到商业化需求的时候。

本贴目的:

  1. 发现问题,求教解决方案;
  2. 万一是个BUG,岂不为社区做了一点小小贡献;
1 个赞

心态不错

好的,有问题欢迎提问及反馈,社区版问题都可以解答

可以看下操作系统内核版本,记得内核版本过低不会开启cgroup

[admin@rocky95 ~]$ cat /etc/os-release
NAME="Rocky Linux"
VERSION="9.5 (Blue Onyx)"
ID="rocky"
ID_LIKE="rhel centos fedora"
VERSION_ID="9.5"
PLATFORM_ID="platform:el9"
PRETTY_NAME="Rocky Linux 9.5 (Blue Onyx)"
ANSI_COLOR="0;32"
LOGO="fedora-logo-icon"
CPE_NAME="cpe:/o:rocky:rocky:9::baseos"
HOME_URL="https://rockylinux.org/"
VENDOR_NAME="RESF"
VENDOR_URL="https://resf.org/"
BUG_REPORT_URL="https://bugs.rockylinux.org/"
SUPPORT_END="2032-05-31"
ROCKY_SUPPORT_PRODUCT="Rocky-Linux-9"
ROCKY_SUPPORT_PRODUCT_VERSION="9.5"
REDHAT_SUPPORT_PRODUCT="Rocky Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="9.5"
[admin@rocky95 ~]$ uname -r
5.14.0-503.14.1.el9_5.x86_64

更新主贴,使用社区版重新部署,还是没有教材中示例的cgroup目录,请帮忙看看。

版本信息都一样吗?

发下OB,OCP版本信息
OCP开启cgroup的截图
cgroup目录信息及挂载信息


看你截图用的cgroup2,印象中目前只支持cgroup1版本,可以改成cgroup 1版本试试

1 个赞

楼上说的对,

相关信息已更新到主贴。

当前环境:VMware中的虚拟机;
安装模式:OCP默认安装开启cgroup;
当前1个租户;


[admin@obocp4 ~]$ cat /etc/rocky-release
Rocky Linux release 9.5 (Blue Onyx)
[admin@obocp4 ~]$ uname -r
5.14.0-503.14.1.el9_5.x86_64

[admin@obocp4 ~]$ mount |grep cgroup
cgroup2 on /sys/fs/cgroup type cgroup2 (rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot)
cgroup on /sys/fs/cgroup/cpuset,cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset,cpu,cpuacct)
[admin@obocp4 ~]$

rocky 9 默认使用cgroup v2 导致?
文档没介绍cgroup 版本要求,哪如何修改呢?

可以搜下文档,修改 /etc/default/grub文件, 找到 GRUB_CMDLINE_LINUX 行,添加 systemd.unified_cgroup_hierarchy=0 (强制使用 cgroup1)

1 个赞

这个试了一把,没有效果;