服务故障，请帮忙看下怎么解决

OceanBase
#1

【 使用环境 】生产环境 or 测试环境
【 OB or 其他组件 】
【 使用版本 】
【问题描述】清晰明确描述问题
【复现路径】问题出现前后相关操作
【附件及日志】推荐使用OceanBase敏捷诊断工具obdiag收集诊断信息,详情参见链接（右键跳转查看）：

【SOP系列 22 】——故障诊断第一步(自助诊断和诊断信息收集)

ERROR [COMMON] print_tenant_usage_ (ob_tenant_mgr.cpp:438) [142][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=92] the hold of observer tenant is over the system_memory(observer_tenant_hold=1266163712, system_memory=1073741824) BACKTRACE:0xb5743eb 0xb65fac6 0x3c4701b 0x3c46d34 0x3c46b49 0x3c253fb 0xad39d7b 0xad39a1d 0xad39804 0x8f267b5 0x8f2649a 0x3a67f23 0xb67da6c 0xb67c1ba 0x7f030f61c14a 0x7f030f34bdc3

运行过程中，报这个错误，请问怎么优化，查看内存还有7个G，CPU4核的，现在用到9个核了，

#3

可以先使用obdiag巡检下集群信息。

#4

可以参考下这个帖子 使用OceanBase 4.0 all-in-one 的obd demo部署单机OB，登录数据库后语句多数报错Can't connect to MySQL server on '127.0.0.1' - #2，来自 绵阳

#5

vi /home/admin/.obd/plugins/obproxy-ce/3.1.0/generate_config.py
vi /home/admin/.obd/plugins/obproxy/3.2.1/generate_config.py
这 proxy_mem_limited 200M改为1000M ，效果还是一样，还在报错呢

#6
  1. 当前ob和obd什么版本的呢？ 查看obd --version。
    2.麻烦提供下完整日志和配置文件呢（~/.obd/cluster/name/config.yaml）
#7

OceanBase Deploy: 1.6.0
oceanbase-ce:
servers:
# Please don’t use hostname, only IP can be supported

  • 127.0.0.1
    global:

    The working directory for OceanBase Database. OceanBase Database is started under this directory. This is a required field.

    home_path: /home/admin/oceanbase-ce

    The directory for data storage. The default value is $home_path/store.

    data_dir: /data/1

    The directory for clog, ilog, and slog. The default value is the same as the data_dir value.

    redo_dir: /data/log1

    Please set devname as the network adaptor’s name whose ip is in the setting of severs.

    if set severs as “127.0.0.1”, please set devname as “lo”

    if current ip is 192.168.1.10, and the ip’s network adaptor’s name is “eth0”, please use “eth0”

    devname: lo
    mysql_port: 2881 # External port for OceanBase Database. The default value is 2881. DO NOT change this value after the cluster is started.
    rpc_port: 2882 # Internal port for OceanBase Database. The default value is 2882. DO NOT change this value after the cluster is started.
    zone: zone1
    cluster_id: 1

    please set memory limit to a suitable value which is matching resource.

    memory_limit: 6G # The maximum running memory for an observer
    system_memory: 1G # The reserved system memory. system_memory is reserved for general tenants. The default value is 30G.
    datafile_size: 5G # Size of the data file.
    log_disk_size: 5G # The size of disk space used by the clog files.
    cpu_count: 16
    production_mode: false
    syslog_level: ERROR # System log level. The default value is INFO.
    enable_syslog_wf: false # Print system logs whose levels are higher than WARNING to a separate log file. The default value is true.
    enable_syslog_recycle: true # Enable auto system log recycling or not. The default value is false.
    max_syslog_file_count: 4 # The maximum number of reserved log files before enabling auto recycling. The default value is 0.

    observer cluster name, consistent with obproxy’s cluster_name

    appname: obdemo
    root_password: rootPWD123 # root user password, can be empty
    proxyro_password: proxyroPWD123 # proxyro user pasword, consistent with obproxy’s observer_sys_password, can be empty
    obproxy-ce:

Set dependent components for the component.

When the associated configurations are not done, OBD will automatically get the these configurations from the dependent components.

depends:

  • oceanbase-ce
    servers:
  • 127.0.0.1
    global:
    listen_port: 2883 # External port. The default value is 2883.
    prometheus_listen_port: 2884 # The Prometheus port. The default value is 2884.
    home_path: /home/admin/obproxy

    oceanbase root server list

    format: ip:mysql_port;ip:mysql_port. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.

    rs_list: 127.0.0.1:2881

    enable_cluster_checkout: false

    observer cluster name, consistent with oceanbase-ce’s appname. When a depends exists, OBD gets this value from the oceanbase-ce of the depends.

    cluster_name: obcluster

    skip_proxy_sys_private_check: true
    enable_strict_kernel_release: false 默认，没修改过，请问该优化哪些指标合适 4C6G的内存
#8

设置2G吧
memory_limit: 6G 改成8G吧
我看obd 1.6.0 可以升级为最新版本2.6.X版本

#9

部署方式是什么呢？

#10

docker

#11

docker 部署的，看版本是4.0.0 ，生产是企业版3.2.3 ，不知道社区版本哪个版本最接近它，最兼容呢？

#12

社区版本没有3.2.x的版本。

#13

现在用社区 4.0.0 版本，它们之间相互备份与恢复数据，不会有问题吧？

#14

意思是社区4.0和生产3.2之间相互备份与恢复数据的嘛？

#15

是的。用obdumper工具

#16

可以的