[root@obsrv2 rpms]# obd display-trace 910f8f06-983b-11ef-b215-5254009652b5 [2024-11-01 18:25:07.598] [DEBUG] - cmd: ['stagoceanbase7'] [2024-11-01 18:25:07.598] [DEBUG] - opts: {'component': 'oceanbase-ce', 'version': '4.3.3.1', 'skip_check': None, 'usable': '', 'disable': '', 'executer_path': '/usr/obd/lib/executer', 'script_query_timeout': '', 'ignore_standby': None} [2024-11-01 18:25:07.599] [DEBUG] - mkdir /root/.obd/lock/ [2024-11-01 18:25:07.599] [DEBUG] - unknown lock mode [2024-11-01 18:25:07.599] [DEBUG] - try to get share lock /root/.obd/lock/global [2024-11-01 18:25:07.599] [DEBUG] - share lock `/root/.obd/lock/global`, count 1 [2024-11-01 18:25:07.599] [DEBUG] - Get Deploy by name [2024-11-01 18:25:07.600] [DEBUG] - mkdir /root/.obd/cluster/ [2024-11-01 18:25:07.600] [DEBUG] - mkdir /root/.obd/config_parser/ [2024-11-01 18:25:07.600] [DEBUG] - try to get exclusive lock /root/.obd/lock/deploy_stagoceanbase7 [2024-11-01 18:25:07.600] [DEBUG] - exclusive lock `/root/.obd/lock/deploy_stagoceanbase7`, count 1 [2024-11-01 18:25:07.609] [DEBUG] - Deploy status judge [2024-11-01 18:25:07.674] [INFO] Get local repositories and plugins [2024-11-01 18:25:07.675] [DEBUG] - mkdir /root/.obd/repository [2024-11-01 18:25:07.676] [DEBUG] - Get local repository oceanbase-ce-4.3.2.1-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:07.676] [DEBUG] - try to get share lock /root/.obd/lock/mirror_and_repo [2024-11-01 18:25:07.676] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 1 [2024-11-01 18:25:07.678] [DEBUG] - Get local repository obproxy-ce-4.2.3.0-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:07.678] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 2 [2024-11-01 18:25:07.680] [DEBUG] - Get local repository obagent-4.2.2-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:07.680] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 3 [2024-11-01 18:25:07.682] [DEBUG] - Get local repository prometheus-2.37.1-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:07.682] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 4 [2024-11-01 18:25:07.684] [DEBUG] - Get local repository grafana-7.5.17-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:07.684] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 5 [2024-11-01 18:25:07.686] [DEBUG] - Get local repository ocp-express-4.2.2-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:07.686] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 6 [2024-11-01 18:25:07.688] [DEBUG] - Get local repository ob-configserver-1.0.0-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:07.689] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 7 [2024-11-01 18:25:07.690] [DEBUG] - Get local repository oblogproxy-2.0.2-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:07.691] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 8 [2024-11-01 18:25:07.692] [DEBUG] - Searching param plugin for components ... [2024-11-01 18:25:07.692] [DEBUG] - Search param plugin for oceanbase-ce [2024-11-01 18:25:07.693] [DEBUG] - mkdir /root/.obd/plugins [2024-11-01 18:25:07.694] [DEBUG] - Found for oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:07.694] [DEBUG] - Applying oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:08.176] [DEBUG] - Search param plugin for obproxy-ce [2024-11-01 18:25:08.176] [DEBUG] - Found for obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0 [2024-11-01 18:25:08.176] [DEBUG] - Applying obproxy-ce-param-4.2.3 for obproxy-ce-4.2.3.0-3.el8-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:08.292] [DEBUG] - Search param plugin for obagent [2024-11-01 18:25:08.292] [DEBUG] - Found for obagent-param-4.2.2 for obagent-4.2.2 [2024-11-01 18:25:08.293] [DEBUG] - Applying obagent-param-4.2.2 for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:08.352] [DEBUG] - Search param plugin for prometheus [2024-11-01 18:25:08.352] [DEBUG] - Found for prometheus-param-2.37.1 for prometheus-2.37.1 [2024-11-01 18:25:08.352] [DEBUG] - Applying prometheus-param-2.37.1 for prometheus-2.37.1-10000102022110211.el8-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:08.368] [DEBUG] - Search param plugin for grafana [2024-11-01 18:25:08.368] [DEBUG] - Found for grafana-param-7.5.17 for grafana-7.5.17 [2024-11-01 18:25:08.368] [DEBUG] - Applying grafana-param-7.5.17 for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:08.391] [DEBUG] - Search param plugin for ocp-express [2024-11-01 18:25:08.391] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.2 [2024-11-01 18:25:08.391] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.2-100000022024011120.el8-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:08.476] [DEBUG] - Search param plugin for ob-configserver [2024-11-01 18:25:08.476] [DEBUG] - Found for ob-configserver-param-1.0.0 for ob-configserver-1.0.0 [2024-11-01 18:25:08.476] [DEBUG] - Applying ob-configserver-param-1.0.0 for ob-configserver-1.0.0-2.el8-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:08.500] [DEBUG] - Search param plugin for oblogproxy [2024-11-01 18:25:08.500] [DEBUG] - Found for oblogproxy-param-2.0.0 for oblogproxy-2.0.2 [2024-11-01 18:25:08.501] [DEBUG] - Applying oblogproxy-param-2.0.0 for oblogproxy-2.0.2-101000142024080121.el8-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:08.728] [DEBUG] - Searching get_standbys plugin for components ... [2024-11-01 18:25:08.728] [DEBUG] - Searching get_standbys plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:08.729] [DEBUG] - Found for oceanbase-ce-py_script_get_standbys-4.2.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:08.729] [DEBUG] - Searching get_standbys plugin for obproxy-ce-4.2.3.0-3.el8-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:08.729] [DEBUG] - No such get_standbys plugin for obproxy-ce-4.2.3.0 [2024-11-01 18:25:08.729] [DEBUG] - Searching get_standbys plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:08.729] [DEBUG] - No such get_standbys plugin for obagent-4.2.2 [2024-11-01 18:25:08.729] [DEBUG] - Searching get_standbys plugin for prometheus-2.37.1-10000102022110211.el8-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:08.729] [DEBUG] - No such get_standbys plugin for prometheus-2.37.1 [2024-11-01 18:25:08.729] [DEBUG] - Searching get_standbys plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:08.730] [DEBUG] - No such get_standbys plugin for grafana-7.5.17 [2024-11-01 18:25:08.730] [DEBUG] - Searching get_standbys plugin for ocp-express-4.2.2-100000022024011120.el8-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:08.730] [DEBUG] - No such get_standbys plugin for ocp-express-4.2.2 [2024-11-01 18:25:08.730] [DEBUG] - Searching get_standbys plugin for ob-configserver-1.0.0-2.el8-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:08.730] [DEBUG] - No such get_standbys plugin for ob-configserver-1.0.0 [2024-11-01 18:25:08.730] [DEBUG] - Searching get_standbys plugin for oblogproxy-2.0.2-101000142024080121.el8-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:08.730] [DEBUG] - No such get_standbys plugin for oblogproxy-2.0.2 [2024-11-01 18:25:08.730] [DEBUG] - Searching get_relation_tenants plugin for components ... [2024-11-01 18:25:08.730] [DEBUG] - Searching get_relation_tenants plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:08.731] [DEBUG] - Found for oceanbase-ce-py_script_get_relation_tenants-4.2.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:08.731] [DEBUG] - Searching get_relation_tenants plugin for obproxy-ce-4.2.3.0-3.el8-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:08.731] [DEBUG] - No such get_relation_tenants plugin for obproxy-ce-4.2.3.0 [2024-11-01 18:25:08.731] [DEBUG] - Searching get_relation_tenants plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:08.731] [DEBUG] - No such get_relation_tenants plugin for obagent-4.2.2 [2024-11-01 18:25:08.731] [DEBUG] - Searching get_relation_tenants plugin for prometheus-2.37.1-10000102022110211.el8-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:08.732] [DEBUG] - No such get_relation_tenants plugin for prometheus-2.37.1 [2024-11-01 18:25:08.732] [DEBUG] - Searching get_relation_tenants plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:08.732] [DEBUG] - No such get_relation_tenants plugin for grafana-7.5.17 [2024-11-01 18:25:08.732] [DEBUG] - Searching get_relation_tenants plugin for ocp-express-4.2.2-100000022024011120.el8-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:08.732] [DEBUG] - No such get_relation_tenants plugin for ocp-express-4.2.2 [2024-11-01 18:25:08.732] [DEBUG] - Searching get_relation_tenants plugin for ob-configserver-1.0.0-2.el8-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:08.732] [DEBUG] - No such get_relation_tenants plugin for ob-configserver-1.0.0 [2024-11-01 18:25:08.732] [DEBUG] - Searching get_relation_tenants plugin for oblogproxy-2.0.2-101000142024080121.el8-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:08.733] [DEBUG] - No such get_relation_tenants plugin for oblogproxy-2.0.2 [2024-11-01 18:25:08.733] [DEBUG] - Searching get_deployment_connections plugin for components ... [2024-11-01 18:25:08.733] [DEBUG] - Searching get_deployment_connections plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:08.733] [DEBUG] - Found for oceanbase-ce-py_script_get_deployment_connections-4.2.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:08.733] [DEBUG] - Searching get_deployment_connections plugin for obproxy-ce-4.2.3.0-3.el8-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:08.733] [DEBUG] - No such get_deployment_connections plugin for obproxy-ce-4.2.3.0 [2024-11-01 18:25:08.734] [DEBUG] - Searching get_deployment_connections plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:08.734] [DEBUG] - No such get_deployment_connections plugin for obagent-4.2.2 [2024-11-01 18:25:08.734] [DEBUG] - Searching get_deployment_connections plugin for prometheus-2.37.1-10000102022110211.el8-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:08.734] [DEBUG] - No such get_deployment_connections plugin for prometheus-2.37.1 [2024-11-01 18:25:08.734] [DEBUG] - Searching get_deployment_connections plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:08.734] [DEBUG] - No such get_deployment_connections plugin for grafana-7.5.17 [2024-11-01 18:25:08.734] [DEBUG] - Searching get_deployment_connections plugin for ocp-express-4.2.2-100000022024011120.el8-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:08.734] [DEBUG] - No such get_deployment_connections plugin for ocp-express-4.2.2 [2024-11-01 18:25:08.735] [DEBUG] - Searching get_deployment_connections plugin for ob-configserver-1.0.0-2.el8-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:08.735] [DEBUG] - No such get_deployment_connections plugin for ob-configserver-1.0.0 [2024-11-01 18:25:08.735] [DEBUG] - Searching get_deployment_connections plugin for oblogproxy-2.0.2-101000142024080121.el8-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:08.735] [DEBUG] - No such get_deployment_connections plugin for oblogproxy-2.0.2 [2024-11-01 18:25:08.735] [DEBUG] - Searching connect plugin for components ... [2024-11-01 18:25:08.735] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:08.736] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:08.736] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.3.0-3.el8-2526073e3c652177b15093be611af94a469e0e21 [2024-11-01 18:25:08.736] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.3.0 [2024-11-01 18:25:08.736] [DEBUG] - Searching connect plugin for obagent-4.2.2-100000042024011120.el8-bf152b880953c2043ddaf80d6180cf22bb8c8ac2 [2024-11-01 18:25:08.736] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.2 [2024-11-01 18:25:08.736] [DEBUG] - Searching connect plugin for prometheus-2.37.1-10000102022110211.el8-e4f8a3e784512fca75bf1b3464247d1f31542cb9 [2024-11-01 18:25:08.737] [DEBUG] - Found for prometheus-py_script_connect-2.37.1 for prometheus-2.37.1 [2024-11-01 18:25:08.737] [DEBUG] - Searching connect plugin for grafana-7.5.17-1-1bf1f338d3a3445d8599dc6902e7aeed4de4e0d6 [2024-11-01 18:25:08.737] [DEBUG] - Found for grafana-py_script_connect-7.5.17 for grafana-7.5.17 [2024-11-01 18:25:08.737] [DEBUG] - Searching connect plugin for ocp-express-4.2.2-100000022024011120.el8-e5c152ebdd65839ed5f5521ff6c73e6a29cb9e75 [2024-11-01 18:25:08.737] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.2 [2024-11-01 18:25:08.737] [DEBUG] - Searching connect plugin for ob-configserver-1.0.0-2.el8-664f93205c913d5dc84e0779d565768fd60f1d5e [2024-11-01 18:25:08.738] [DEBUG] - Found for ob-configserver-py_script_connect-1.0.0 for ob-configserver-1.0.0 [2024-11-01 18:25:08.738] [DEBUG] - Searching connect plugin for oblogproxy-2.0.2-101000142024080121.el8-2c1c17514d762ce628548282e1c0d6491d0fd34e [2024-11-01 18:25:08.738] [DEBUG] - Found for oblogproxy-py_script_connect-2.0.0 for oblogproxy-2.0.2 [2024-11-01 18:25:08.738] [INFO] Open ssh connection [2024-11-01 18:25:08.742] [DEBUG] - host: 10.1.250.161, port: 22, user: obadmin, password: 12345678! [2024-11-01 18:25:09.047] [DEBUG] - host: 10.1.250.161, port: 22, user: obadmin, password: 12345678! [2024-11-01 18:25:09.354] [DEBUG] - host: 10.1.250.160, port: 22, user: obadmin, password: 12345678! [2024-11-01 18:25:09.664] [DEBUG] - host: 10.1.250.157, port: 22, user: obadmin, password: 12345678! [2024-11-01 18:25:10.083] [DEBUG] - Call oceanbase-ce-py_script_get_relation_tenants-4.2.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:10.083] [DEBUG] - import get_relation_tenants [2024-11-01 18:25:10.084] [DEBUG] - add get_relation_tenants ref count to 1 [2024-11-01 18:25:10.084] [DEBUG] - exclusive lock `/root/.obd/lock/deploy_stagoceanbase7`, count 2 [2024-11-01 18:25:10.148] [DEBUG] - sub get_relation_tenants ref count to 0 [2024-11-01 18:25:10.148] [DEBUG] - export get_relation_tenants [2024-11-01 18:25:10.148] [DEBUG] - plugin oceanbase-ce-py_script_get_relation_tenants-4.2.0.0 result: True [2024-11-01 18:25:10.148] [DEBUG] - Call oceanbase-ce-py_script_get_deployment_connections-4.2.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:10.148] [DEBUG] - import get_deployment_connections [2024-11-01 18:25:10.149] [DEBUG] - add get_deployment_connections ref count to 1 [2024-11-01 18:25:10.149] [INFO] Get deployment connections [2024-11-01 18:25:10.676] [DEBUG] - sub get_deployment_connections ref count to 0 [2024-11-01 18:25:10.676] [DEBUG] - export get_deployment_connections [2024-11-01 18:25:10.676] [DEBUG] - plugin oceanbase-ce-py_script_get_deployment_connections-4.2.0.0 result: True [2024-11-01 18:25:10.677] [DEBUG] - Call oceanbase-ce-py_script_get_standbys-4.2.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:10.677] [DEBUG] - import get_standbys [2024-11-01 18:25:10.678] [DEBUG] - add get_standbys ref count to 1 [2024-11-01 18:25:10.678] [INFO] Get standbys info [2024-11-01 18:25:10.809] [DEBUG] - sub get_standbys ref count to 0 [2024-11-01 18:25:10.810] [DEBUG] - export get_standbys [2024-11-01 18:25:10.810] [DEBUG] - plugin oceanbase-ce-py_script_get_standbys-4.2.0.0 result: True [2024-11-01 18:25:10.810] [DEBUG] - search target version [2024-11-01 18:25:10.810] [DEBUG] - mkdir /root/.obd/mirror [2024-11-01 18:25:10.810] [DEBUG] - mkdir /root/.obd/mirror/remote [2024-11-01 18:25:10.810] [DEBUG] - mkdir /root/.obd/mirror/local [2024-11-01 18:25:10.811] [DEBUG] - try to get exclusive lock /root/.obd/lock/mirror_and_repo [2024-11-01 18:25:10.811] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 1 [2024-11-01 18:25:10.811] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 2 [2024-11-01 18:25:10.811] [DEBUG] - load repo config: /root/.obd/mirror/remote/OceanBase.repo [2024-11-01 18:25:10.811] [DEBUG] - open /root/.obd/mirror/remote/OceanBase.repo for r [2024-11-01 18:25:10.812] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 3 [2024-11-01 18:25:10.813] [DEBUG] - md5 is None [2024-11-01 18:25:10.813] [DEBUG] - name is oceanbase-ce [2024-11-01 18:25:10.813] [DEBUG] - arch is ['ia32e', 'x86_64', 'athlon', 'i686', 'i586', 'i486', 'i386', 'noarch'] [2024-11-01 18:25:10.813] [DEBUG] - release is None [2024-11-01 18:25:10.813] [DEBUG] - version is 4.3.3.1. [2024-11-01 18:25:10.814] [DEBUG] - share lock `/root/.obd/lock/mirror_and_repo`, count 9 [2024-11-01 18:25:10.814] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce [2024-11-01 18:25:10.819] [INFO] +-----------------------------------------------------------------------------------------------------+ [2024-11-01 18:25:10.819] [INFO] | Search oceanbase-ce 4.3.3.1 Result | [2024-11-01 18:25:10.819] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+ [2024-11-01 18:25:10.819] [INFO] | name | version | release | arch | md5 | [2024-11-01 18:25:10.819] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+ [2024-11-01 18:25:10.819] [INFO] | oceanbase-ce | 4.3.3.1 | 101000012024102216.el8 | x86_64 | 1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af | [2024-11-01 18:25:10.819] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+ [2024-11-01 18:25:10.819] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 4 [2024-11-01 18:25:10.819] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 5 [2024-11-01 18:25:10.819] [DEBUG] - load repo config: /root/.obd/mirror/remote/OceanBase.repo [2024-11-01 18:25:10.819] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 6 [2024-11-01 18:25:10.820] [DEBUG] - md5 is 1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.820] [DEBUG] - MirrorRepositoryType.LOCAL mirror local found pkg: name: oceanbase-ce [2024-11-01 18:25:10.820] [DEBUG] version: 4.3.3.1 [2024-11-01 18:25:10.820] [DEBUG] release:101000012024102216.el8 [2024-11-01 18:25:10.820] [DEBUG] arch: x86_64 [2024-11-01 18:25:10.820] [DEBUG] md5: 1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.820] [DEBUG] size: 731895999 [2024-11-01 18:25:10.820] [DEBUG] - get RPM package by name: oceanbase-ce [2024-11-01 18:25:10.820] [DEBUG] version: 4.3.3.1 [2024-11-01 18:25:10.820] [DEBUG] release:101000012024102216.el8 [2024-11-01 18:25:10.820] [DEBUG] arch: x86_64 [2024-11-01 18:25:10.820] [DEBUG] md5: 1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.820] [DEBUG] size: 731895999 [2024-11-01 18:25:10.821] [DEBUG] - Searching install plugin for components ... [2024-11-01 18:25:10.821] [DEBUG] - Searching install plugin for components ... [2024-11-01 18:25:10.821] [DEBUG] - Search install plugin for oceanbase-ce [2024-11-01 18:25:10.821] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:10.821] [DEBUG] - exclusive lock `/root/.obd/lock/mirror_and_repo`, count 7 [2024-11-01 18:25:10.822] [DEBUG] - mkdir /root/.obd/repository/oceanbase-ce/4.3.3.1/1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.824] [DEBUG] - create instance repository for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:10.829] [DEBUG] - oceanbase-ce-4.3.3.1 is already install [2024-11-01 18:25:10.829] [INFO] Cluster status check [2024-11-01 18:25:10.830] [DEBUG] - Searching status plugin for components ... [2024-11-01 18:25:10.830] [DEBUG] - Searching status plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.830] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:10.831] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:10.831] [DEBUG] - import status [2024-11-01 18:25:10.831] [DEBUG] - add status ref count to 1 [2024-11-01 18:25:10.831] [DEBUG] -- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:10.865] [DEBUG] -- exited code 0 [2024-11-01 18:25:10.866] [DEBUG] -- obadmin@10.1.250.161 execute: ls /proc/749123 [2024-11-01 18:25:10.942] [DEBUG] -- exited code 0 [2024-11-01 18:25:10.942] [DEBUG] -- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:11.025] [DEBUG] -- exited code 0 [2024-11-01 18:25:11.025] [DEBUG] -- obadmin@10.1.250.160 execute: ls /proc/818023 [2024-11-01 18:25:11.150] [DEBUG] -- exited code 0 [2024-11-01 18:25:11.151] [DEBUG] -- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:11.182] [DEBUG] -- exited code 0 [2024-11-01 18:25:11.183] [DEBUG] -- obadmin@10.1.250.157 execute: ls /proc/917192 [2024-11-01 18:25:11.254] [DEBUG] -- exited code 0 [2024-11-01 18:25:11.255] [DEBUG] - sub status ref count to 0 [2024-11-01 18:25:11.255] [DEBUG] - export status [2024-11-01 18:25:11.255] [DEBUG] - plugin oceanbase-ce-py_script_status-3.1.0 result: True [2024-11-01 18:25:11.549] [DEBUG] - Searching upgrade_pre plugin for components ... [2024-11-01 18:25:11.550] [DEBUG] - Searching upgrade_pre plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:11.550] [DEBUG] - No such upgrade_pre plugin for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:11.550] [DEBUG] - Searching param plugin for components ... [2024-11-01 18:25:11.550] [DEBUG] - Search param plugin for oceanbase-ce [2024-11-01 18:25:11.551] [DEBUG] - Found for oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:11.551] [DEBUG] - Applying oceanbase-ce-param-4.3.3.0 for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:12.044] [DEBUG] - Searching start_check plugin for components ... [2024-11-01 18:25:12.044] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:12.045] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:12.045] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.3.0.0 for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:12.045] [DEBUG] - import start_check [2024-11-01 18:25:12.052] [DEBUG] - add start_check ref count to 1 [2024-11-01 18:25:12.052] [INFO] Check before upgrade observer [2024-11-01 18:25:12.056] [DEBUG] -- obadmin@10.1.250.161 execute: ls /data1/stag_oceanbase/observer7/store/clog/tenant_1/ [2024-11-01 18:25:12.090] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.090] [DEBUG] -- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:12.164] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.164] [DEBUG] -- obadmin@10.1.250.161 execute: ls /proc/749123 [2024-11-01 18:25:12.239] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.239] [DEBUG] -- server1(10.1.250.161) is runnning, skip [2024-11-01 18:25:12.243] [DEBUG] -- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:12.326] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.327] [DEBUG] -- obadmin@10.1.250.160 execute: ls /proc/818023 [2024-11-01 18:25:12.452] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.452] [DEBUG] -- server2(10.1.250.160) is runnning, skip [2024-11-01 18:25:12.455] [DEBUG] -- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:12.486] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.486] [DEBUG] -- obadmin@10.1.250.157 execute: ls /proc/917192 [2024-11-01 18:25:12.557] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.557] [DEBUG] -- server3(10.1.250.157) is runnning, skip [2024-11-01 18:25:12.558] [DEBUG] -- obadmin@10.1.250.161 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-11-01 18:25:12.593] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.593] [DEBUG] -- obadmin@10.1.250.161 execute: ulimit -a [2024-11-01 18:25:12.665] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.666] [DEBUG] -- obadmin@10.1.250.161 execute: sysctl -a [2024-11-01 18:25:12.832] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.842] [DEBUG] -- obadmin@10.1.250.161 execute: cat /proc/meminfo [2024-11-01 18:25:12.907] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.908] [DEBUG] -- obadmin@10.1.250.161 execute: df --block-size=1024 [2024-11-01 18:25:12.983] [DEBUG] -- exited code 0 [2024-11-01 18:25:12.983] [DEBUG] -- get disk info for path /dev, total: 134817816576 avail: 134817816576 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /dev/shm, total: 134838026240 avail: 134838026240 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /run, total: 134838026240 avail: 132308160512 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 134838026240 avail: 134838026240 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /, total: 580610686976 avail: 247410012160 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /data, total: 2047406649344 avail: 1406731456512 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /storage, total: 599255748608 avail: 194415452160 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /boot, total: 8579448832 avail: 8062390272 [2024-11-01 18:25:12.984] [DEBUG] -- get disk info for path /boot/efi, total: 627900416 avail: 621838336 [2024-11-01 18:25:12.985] [DEBUG] -- get disk info for path /storage2, total: 15998224695296 avail: 13379031695360 [2024-11-01 18:25:12.985] [DEBUG] -- get disk info for path /run/user/972, total: 26967605248 avail: 26967605248 [2024-11-01 18:25:12.985] [DEBUG] -- get disk info for path /run/user/0, total: 26967605248 avail: 26967605248 [2024-11-01 18:25:12.985] [DEBUG] -- get disk info for path /storage3, total: 15873098444800 avail: 14160796946432 [2024-11-01 18:25:12.985] [DEBUG] -- get disk info for path /run/user/1009, total: 26967605248 avail: 26967605248 [2024-11-01 18:25:12.985] [DEBUG] -- disk: {'/dev': {'total': 134817816576, 'avail': 134817816576, 'need': 0}, '/dev/shm': {'total': 134838026240, 'avail': 134838026240, 'need': 0}, '/run': {'total': 134838026240, 'avail': 132308160512, 'need': 0}, '/sys/fs/cgroup': {'total': 134838026240, 'avail': 134838026240, 'need': 0}, '/': {'total': 580610686976, 'avail': 247410012160, 'need': 0}, '/data': {'total': 2047406649344, 'avail': 1406731456512, 'need': 0}, '/storage': {'total': 599255748608, 'avail': 194415452160, 'need': 0}, '/boot': {'total': 8579448832, 'avail': 8062390272, 'need': 0}, '/boot/efi': {'total': 627900416, 'avail': 621838336, 'need': 0}, '/storage2': {'total': 15998224695296, 'avail': 13379031695360, 'need': 0}, '/run/user/972': {'total': 26967605248, 'avail': 26967605248, 'need': 0}, '/run/user/0': {'total': 26967605248, 'avail': 26967605248, 'need': 0}, '/storage3': {'total': 15873098444800, 'avail': 14160796946432, 'need': 0}, '/run/user/1009': {'total': 26967605248, 'avail': 26967605248, 'need': 0}} [2024-11-01 18:25:12.985] [DEBUG] -- obadmin@10.1.250.160 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-11-01 18:25:13.067] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.068] [DEBUG] -- obadmin@10.1.250.160 execute: ulimit -a [2024-11-01 18:25:13.190] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.190] [DEBUG] -- obadmin@10.1.250.160 execute: sysctl -a [2024-11-01 18:25:13.380] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.387] [DEBUG] -- obadmin@10.1.250.160 execute: cat /proc/meminfo [2024-11-01 18:25:13.504] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.505] [DEBUG] -- obadmin@10.1.250.160 execute: df --block-size=1024 [2024-11-01 18:25:13.627] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.628] [DEBUG] -- get disk info for path /dev, total: 84321177600 avail: 84321177600 [2024-11-01 18:25:13.628] [DEBUG] -- get disk info for path /dev/shm, total: 84339904512 avail: 84339904512 [2024-11-01 18:25:13.628] [DEBUG] -- get disk info for path /run, total: 84339904512 avail: 79966609408 [2024-11-01 18:25:13.628] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 84339904512 avail: 84339904512 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /, total: 196398809088 avail: 41160892416 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /data1, total: 2047406649344 avail: 1339106508800 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /boot, total: 4284481536 avail: 3900973056 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /home, total: 380992225280 avail: 39847387136 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /run/user/0, total: 16867979264 avail: 16867979264 [2024-11-01 18:25:13.629] [DEBUG] -- get disk info for path /run/user/1006, total: 16867979264 avail: 16867979264 [2024-11-01 18:25:13.629] [DEBUG] -- disk: {'/dev': {'total': 84321177600, 'avail': 84321177600, 'need': 0}, '/dev/shm': {'total': 84339904512, 'avail': 84339904512, 'need': 0}, '/run': {'total': 84339904512, 'avail': 79966609408, 'need': 0}, '/sys/fs/cgroup': {'total': 84339904512, 'avail': 84339904512, 'need': 0}, '/': {'total': 196398809088, 'avail': 41160892416, 'need': 0}, '/data1': {'total': 2047406649344, 'avail': 1339106508800, 'need': 0}, '/boot': {'total': 4284481536, 'avail': 3900973056, 'need': 0}, '/home': {'total': 380992225280, 'avail': 39847387136, 'need': 0}, '/run/user/0': {'total': 16867979264, 'avail': 16867979264, 'need': 0}, '/run/user/1006': {'total': 16867979264, 'avail': 16867979264, 'need': 0}} [2024-11-01 18:25:13.629] [DEBUG] -- obadmin@10.1.250.157 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-11-01 18:25:13.662] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.663] [DEBUG] -- obadmin@10.1.250.157 execute: ulimit -a [2024-11-01 18:25:13.738] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.738] [DEBUG] -- obadmin@10.1.250.157 execute: sysctl -a [2024-11-01 18:25:13.871] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.878] [DEBUG] -- obadmin@10.1.250.157 execute: cat /proc/meminfo [2024-11-01 18:25:13.945] [DEBUG] -- exited code 0 [2024-11-01 18:25:13.946] [DEBUG] -- obadmin@10.1.250.157 execute: df --block-size=1024 [2024-11-01 18:25:14.022] [DEBUG] -- exited code 0 [2024-11-01 18:25:14.022] [DEBUG] -- get disk info for path /dev, total: 134890708992 avail: 134890708992 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /dev/shm, total: 134908243968 avail: 134906597376 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /run, total: 134908243968 avail: 130514997248 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 134908243968 avail: 134908243968 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /, total: 160982630400 avail: 42099306496 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /data, total: 399891963904 avail: 43501268992 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /data1, total: 2047406649344 avail: 1528483553280 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /home, total: 324111695872 avail: 105992290304 [2024-11-01 18:25:14.023] [DEBUG] -- get disk info for path /boot, total: 4284481536 avail: 3929632768 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /boot/efi, total: 627900416 avail: 621838336 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /run/user/1001, total: 26981646336 avail: 26981646336 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /run/user/0, total: 26981646336 avail: 26981646336 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /run/user/1009, total: 26981646336 avail: 26981646336 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /run/user/1006, total: 26981646336 avail: 26981646336 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/a2075359-c218-e3db-3320-cf6badc78611/small-saas-api-green/secrets, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/a2075359-c218-e3db-3320-cf6badc78611/small-saas-api-green/private, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/0cba71f5-c524-167e-c365-60ecc8ed2c10/small-saas-api-blue/secrets, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/0cba71f5-c524-167e-c365-60ecc8ed2c10/small-saas-api-blue/private, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/d2f25dea-80fd-7351-b55b-37a8eddd535e/small-saas-api-green/secrets, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/d2f25dea-80fd-7351-b55b-37a8eddd535e/small-saas-api-green/private, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.024] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/1f1327c8-845c-25c7-b2ff-c9b8a7c6a3ce/small-saas-api-blue/secrets, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.025] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/1f1327c8-845c-25c7-b2ff-c9b8a7c6a3ce/small-saas-api-blue/private, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.025] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/e09ecba5-e4db-e269-6922-4885e496cca1/small-saas-api-green/secrets, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.025] [DEBUG] -- get disk info for path /data1/nomad/data/alloc/e09ecba5-e4db-e269-6922-4885e496cca1/small-saas-api-green/private, total: 1048576 avail: 1048576 [2024-11-01 18:25:14.025] [DEBUG] -- disk: {'/dev': {'total': 134890708992, 'avail': 134890708992, 'need': 0}, '/dev/shm': {'total': 134908243968, 'avail': 134906597376, 'need': 0}, '/run': {'total': 134908243968, 'avail': 130514997248, 'need': 0}, '/sys/fs/cgroup': {'total': 134908243968, 'avail': 134908243968, 'need': 0}, '/': {'total': 160982630400, 'avail': 42099306496, 'need': 0}, '/data': {'total': 399891963904, 'avail': 43501268992, 'need': 0}, '/data1': {'total': 2047406649344, 'avail': 1528483553280, 'need': 0}, '/home': {'total': 324111695872, 'avail': 105992290304, 'need': 0}, '/boot': {'total': 4284481536, 'avail': 3929632768, 'need': 0}, '/boot/efi': {'total': 627900416, 'avail': 621838336, 'need': 0}, '/run/user/1001': {'total': 26981646336, 'avail': 26981646336, 'need': 0}, '/run/user/0': {'total': 26981646336, 'avail': 26981646336, 'need': 0}, '/run/user/1009': {'total': 26981646336, 'avail': 26981646336, 'need': 0}, '/run/user/1006': {'total': 26981646336, 'avail': 26981646336, 'need': 0}, '/data1/nomad/data/alloc/a2075359-c218-e3db-3320-cf6badc78611/small-saas-api-green/secrets': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/a2075359-c218-e3db-3320-cf6badc78611/small-saas-api-green/private': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/0cba71f5-c524-167e-c365-60ecc8ed2c10/small-saas-api-blue/secrets': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/0cba71f5-c524-167e-c365-60ecc8ed2c10/small-saas-api-blue/private': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/d2f25dea-80fd-7351-b55b-37a8eddd535e/small-saas-api-green/secrets': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/d2f25dea-80fd-7351-b55b-37a8eddd535e/small-saas-api-green/private': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/1f1327c8-845c-25c7-b2ff-c9b8a7c6a3ce/small-saas-api-blue/secrets': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/1f1327c8-845c-25c7-b2ff-c9b8a7c6a3ce/small-saas-api-blue/private': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/e09ecba5-e4db-e269-6922-4885e496cca1/small-saas-api-green/secrets': {'total': 1048576, 'avail': 1048576, 'need': 0}, '/data1/nomad/data/alloc/e09ecba5-e4db-e269-6922-4885e496cca1/small-saas-api-green/private': {'total': 1048576, 'avail': 1048576, 'need': 0}} [2024-11-01 18:25:14.025] [DEBUG] -- obadmin@10.1.250.161 execute: date +%s%N [2024-11-01 18:25:14.060] [DEBUG] -- exited code 0 [2024-11-01 18:25:14.061] [DEBUG] -- 10.1.250.161 time delta 20.915283203125 [2024-11-01 18:25:14.061] [DEBUG] -- obadmin@10.1.250.160 execute: date +%s%N [2024-11-01 18:25:14.147] [DEBUG] -- exited code 0 [2024-11-01 18:25:14.147] [DEBUG] -- 10.1.250.160 time delta 72.746337890625 [2024-11-01 18:25:14.147] [DEBUG] -- obadmin@10.1.250.157 execute: date +%s%N [2024-11-01 18:25:14.181] [DEBUG] -- exited code 0 [2024-11-01 18:25:14.182] [DEBUG] -- 10.1.250.157 time delta 28.069091796875 [2024-11-01 18:25:14.279] [DEBUG] - sub start_check ref count to 0 [2024-11-01 18:25:14.280] [DEBUG] - export start_check [2024-11-01 18:25:14.280] [DEBUG] - plugin oceanbase-ce-py_script_start_check-4.3.0.0 result: True [2024-11-01 18:25:14.280] [DEBUG] - Searching upgrade_route plugin for components ... [2024-11-01 18:25:14.280] [DEBUG] - Searching upgrade_route plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:14.281] [DEBUG] - Found for oceanbase-ce-py_script_upgrade_route-4.0.0.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:14.281] [DEBUG] - Call oceanbase-ce-py_script_upgrade_route-4.0.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:14.281] [DEBUG] - import upgrade_route [2024-11-01 18:25:14.283] [DEBUG] - add upgrade_route ref count to 1 [2024-11-01 18:25:14.302] [DEBUG] - sub upgrade_route ref count to 0 [2024-11-01 18:25:14.302] [DEBUG] - export upgrade_route [2024-11-01 18:25:14.302] [DEBUG] - plugin oceanbase-ce-py_script_upgrade_route-4.0.0.0 result: True [2024-11-01 18:25:14.302] [DEBUG] - Searching upgrade_check plugin for components ... [2024-11-01 18:25:14.302] [DEBUG] - Searching upgrade_check plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:14.303] [DEBUG] - Found for oceanbase-ce-py_script_upgrade_check-4.2.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:14.303] [DEBUG] - Searching upgrade_check plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:14.303] [DEBUG] - Found for oceanbase-ce-py_script_upgrade_check-4.2.0.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:14.303] [DEBUG] - Searching connect plugin for components ... [2024-11-01 18:25:14.303] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:14.304] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:14.304] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:14.304] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:14.304] [DEBUG] - Call oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:14.305] [DEBUG] -- connect obshell (10.1.250.161:2886) [2024-11-01 18:25:14.305] [DEBUG] -- connect obshell (10.1.250.160:2886) [2024-11-01 18:25:14.305] [DEBUG] -- connect obshell (10.1.250.157:2886) [2024-11-01 18:25:14.305] [INFO] Connect to observer [2024-11-01 18:25:14.306] [DEBUG] -- connect 10.1.250.161 -P2881 -uroot -p****** [2024-11-01 18:25:14.309] [DEBUG] -- execute sql: select 1. args: None [2024-11-01 18:25:14.438] [DEBUG] - plugin oceanbase-ce-py_script_connect-4.2.2.0 result: True [2024-11-01 18:25:14.438] [DEBUG] - Call oceanbase-ce-py_script_upgrade_check-4.2.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:14.438] [DEBUG] - import upgrade_check [2024-11-01 18:25:14.439] [DEBUG] - add upgrade_check ref count to 1 [2024-11-01 18:25:14.440] [DEBUG] -- execute sql: select a.tenant_name, a.tenant_id, group_concat(zone_list separator ';') as zone_list from oceanbase.DBA_OB_TENANTS as a left join ( [2024-11-01 18:25:14.441] [DEBUG] select zone_list, tenant_id from oceanbase.DBA_OB_RESOURCE_POOLS ) as b [2024-11-01 18:25:14.441] [DEBUG] on a.tenant_id = b.tenant_id where a.tenant_name not like 'META$%' group by tenant_id. args: None [2024-11-01 18:25:14.449] [DEBUG] -- route 4.3.3.1-None use oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af. file check begin. [2024-11-01 18:25:14.449] [DEBUG] - sub upgrade_check ref count to 0 [2024-11-01 18:25:14.449] [DEBUG] - export upgrade_check [2024-11-01 18:25:14.449] [DEBUG] - plugin oceanbase-ce-py_script_upgrade_check-4.2.0.0 result: True [2024-11-01 18:25:14.451] [INFO] +-------------------------------------------------------------------------------------------------------------+ [2024-11-01 18:25:14.451] [INFO] | Packages Will Be Used | [2024-11-01 18:25:14.451] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+-------+ [2024-11-01 18:25:14.451] [INFO] | name | version | release | arch | md5 | mark | [2024-11-01 18:25:14.451] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+-------+ [2024-11-01 18:25:14.451] [INFO] | oceanbase-ce | 4.3.2.1 | 100000102024081217.el8 | x86_64 | 01fb9a0311b13cedcf7fd013202e631595510130 | start | [2024-11-01 18:25:14.451] [INFO] | oceanbase-ce | 4.3.3.1 | 101000012024102216.el8 | x86_64 | 1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af | dest | [2024-11-01 18:25:14.451] [INFO] +--------------+---------+------------------------+--------+------------------------------------------+-------+ [2024-11-01 18:25:14.451] [INFO] If you use a non-official release, we cannot guarantee a successful upgrade or technical support when you fail. Make sure that you want to use the above package to upgrade. [y/n]: [2024-11-01 18:25:18.731] [DEBUG] - dump upgrade meta data to /root/.obd/cluster/stagoceanbase7/.upgrade [2024-11-01 18:25:18.735] [DEBUG] - dump deploy info to /root/.obd/cluster/stagoceanbase7/.data [2024-11-01 18:25:18.739] [DEBUG] - Searching install plugin for components ... [2024-11-01 18:25:18.739] [DEBUG] - Search install plugin for oceanbase-ce [2024-11-01 18:25:18.739] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:18.740] [DEBUG] - Search install plugin for oceanbase-ce [2024-11-01 18:25:18.740] [DEBUG] - Found for oceanbase-ce-install-4.0.0.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:18.740] [DEBUG] - Searching install plugin for components ... [2024-11-01 18:25:18.740] [DEBUG] - Searching upgrade plugin for components ... [2024-11-01 18:25:18.740] [DEBUG] - Searching upgrade plugin for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:18.741] [DEBUG] - Found for oceanbase-ce-py_script_upgrade-4.2.2.0 for oceanbase-ce-4.3.3.1 [2024-11-01 18:25:18.741] [DEBUG] - Call oceanbase-ce-py_script_upgrade-4.2.2.0 for oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:18.741] [DEBUG] - import upgrade [2024-11-01 18:25:18.746] [DEBUG] - add upgrade ref count to 1 [2024-11-01 18:25:18.748] [DEBUG] - Searching param plugin for components ... [2024-11-01 18:25:18.748] [DEBUG] - Search param plugin for oceanbase-ce [2024-11-01 18:25:18.748] [DEBUG] - Found for oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:18.748] [DEBUG] - Applying oceanbase-ce-param-4.3.0.0 for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:18.749] [DEBUG] - Searching start plugin for components ... [2024-11-01 18:25:18.749] [DEBUG] - Searching start plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:18.750] [DEBUG] - Found for oceanbase-ce-py_script_start-4.3.0.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:18.750] [DEBUG] --- import start [2024-11-01 18:25:18.753] [DEBUG] --- add start ref count to 1 [2024-11-01 18:25:18.754] [INFO] cluster scenario: htap [2024-11-01 18:25:18.754] [INFO] Start observer [2024-11-01 18:25:18.756] [DEBUG] ---- obadmin@10.1.250.161 execute: ls /data1/stag_oceanbase/observer7/store/clog/tenant_1/ [2024-11-01 18:25:18.792] [DEBUG] ---- exited code 0 [2024-11-01 18:25:18.793] [DEBUG] ---- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:18.865] [DEBUG] ---- exited code 0 [2024-11-01 18:25:18.865] [DEBUG] ---- obadmin@10.1.250.161 execute: ls /proc/749123 [2024-11-01 18:25:18.941] [DEBUG] ---- exited code 0 [2024-11-01 18:25:18.942] [DEBUG] ---- obadmin@10.1.250.160 execute: ls /data1/stag_oceanbase/observer7/store/clog/tenant_1/ [2024-11-01 18:25:19.029] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.030] [DEBUG] ---- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:19.153] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.153] [DEBUG] ---- obadmin@10.1.250.160 execute: ls /proc/818023 [2024-11-01 18:25:19.275] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.275] [DEBUG] ---- obadmin@10.1.250.157 execute: ls /data1/stag_oceanbase/observer7/store/clog/tenant_1/ [2024-11-01 18:25:19.307] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.307] [DEBUG] ---- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:19.383] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.383] [DEBUG] ---- obadmin@10.1.250.157 execute: ls /proc/917192 [2024-11-01 18:25:19.456] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.539] [DEBUG] ---- start_obshell: True [2024-11-01 18:25:19.539] [DEBUG] ---- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:19.574] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.575] [DEBUG] ---- obadmin@10.1.250.161 execute: ls /proc/749271 [2024-11-01 18:25:19.647] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.648] [DEBUG] ---- server1(10.1.250.161) obshell[pid: 749271] started [2024-11-01 18:25:19.648] [DEBUG] ---- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:19.727] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.728] [DEBUG] ---- obadmin@10.1.250.160 execute: ls /proc/818786 [2024-11-01 18:25:19.850] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.851] [DEBUG] ---- server2(10.1.250.160) obshell[pid: 818786] started [2024-11-01 18:25:19.851] [DEBUG] ---- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:19.883] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.884] [DEBUG] ---- obadmin@10.1.250.157 execute: ls /proc/918078 [2024-11-01 18:25:19.956] [DEBUG] ---- exited code 0 [2024-11-01 18:25:19.957] [DEBUG] ---- server3(10.1.250.157) obshell[pid: 918078] started [2024-11-01 18:25:19.957] [INFO] observer program health check [2024-11-01 18:25:22.961] [DEBUG] ---- server1(10.1.250.161) program health check [2024-11-01 18:25:22.961] [DEBUG] ---- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:22.994] [DEBUG] ---- exited code 0 [2024-11-01 18:25:22.995] [DEBUG] ---- obadmin@10.1.250.161 execute: ls /proc/749123 [2024-11-01 18:25:23.068] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.069] [DEBUG] ---- server1(10.1.250.161) observer[pid: 749123] started [2024-11-01 18:25:23.069] [DEBUG] ---- server2(10.1.250.160) program health check [2024-11-01 18:25:23.069] [DEBUG] ---- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:23.152] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.153] [DEBUG] ---- obadmin@10.1.250.160 execute: ls /proc/818023 [2024-11-01 18:25:23.275] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.275] [DEBUG] ---- server2(10.1.250.160) observer[pid: 818023] started [2024-11-01 18:25:23.276] [DEBUG] ---- server3(10.1.250.157) program health check [2024-11-01 18:25:23.276] [DEBUG] ---- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/observer.pid [2024-11-01 18:25:23.307] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.308] [DEBUG] ---- obadmin@10.1.250.157 execute: ls /proc/917192 [2024-11-01 18:25:23.383] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.384] [DEBUG] ---- server3(10.1.250.157) observer[pid: 917192] started [2024-11-01 18:25:23.480] [INFO] obshell program health check [2024-11-01 18:25:23.481] [DEBUG] ---- obadmin@10.1.250.161 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:23.514] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.514] [DEBUG] ---- obadmin@10.1.250.161 execute: ls /proc/749271 [2024-11-01 18:25:23.589] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.589] [DEBUG] ---- server1(10.1.250.161) obshell[pid: 749271] started [2024-11-01 18:25:23.590] [DEBUG] ---- obadmin@10.1.250.160 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:23.671] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.671] [DEBUG] ---- obadmin@10.1.250.160 execute: ls /proc/818786 [2024-11-01 18:25:23.793] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.793] [DEBUG] ---- server2(10.1.250.160) obshell[pid: 818786] started [2024-11-01 18:25:23.793] [DEBUG] ---- obadmin@10.1.250.157 execute: cat /data1/stag_oceanbase/observer7/run/obshell.pid [2024-11-01 18:25:23.825] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.826] [DEBUG] ---- obadmin@10.1.250.157 execute: ls /proc/918078 [2024-11-01 18:25:23.899] [DEBUG] ---- exited code 0 [2024-11-01 18:25:23.900] [DEBUG] ---- server3(10.1.250.157) obshell[pid: 918078] started [2024-11-01 18:25:24.003] [DEBUG] ---- need_bootstrap: False [2024-11-01 18:25:24.003] [DEBUG] --- sub start ref count to 0 [2024-11-01 18:25:24.003] [DEBUG] --- export start [2024-11-01 18:25:24.003] [DEBUG] --- plugin oceanbase-ce-py_script_start-4.3.0.0 result: True [2024-11-01 18:25:24.003] [DEBUG] - Searching connect plugin for components ... [2024-11-01 18:25:24.004] [DEBUG] - Searching connect plugin for oceanbase-ce-4.3.2.1-100000102024081217.el8-01fb9a0311b13cedcf7fd013202e631595510130 [2024-11-01 18:25:24.004] [DEBUG] - Found for oceanbase-ce-py_script_connect-4.2.2.0 for oceanbase-ce-4.3.2.1 [2024-11-01 18:25:24.004] [DEBUG] ---- connect obshell (10.1.250.161:2886) [2024-11-01 18:25:24.004] [DEBUG] ---- connect obshell (10.1.250.160:2886) [2024-11-01 18:25:24.005] [DEBUG] ---- connect obshell (10.1.250.157:2886) [2024-11-01 18:25:24.005] [INFO] Connect to observer [2024-11-01 18:25:24.006] [DEBUG] ---- connect 10.1.250.161 -P2881 -uroot -p****** [2024-11-01 18:25:24.009] [DEBUG] ---- execute sql: select 1. args: None [2024-11-01 18:25:24.137] [DEBUG] --- plugin oceanbase-ce-py_script_connect-4.2.2.0 result: True [2024-11-01 18:25:24.137] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-11-01 18:25:24.139] [DEBUG] ---- execute sql: set session ob_query_timeout=1000000000. args: None [2024-11-01 18:25:24.140] [DEBUG] -- upgrade oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af to oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af [2024-11-01 18:25:24.140] [DEBUG] ---- execute sql: select SVR_IP,SVR_PORT,NAME,VALUE from oceanbase.GV$OB_PARAMETERS where name in %s . args: [('server_permanent_offline_time', 'enable_rebalance', 'enable_rereplication')] [2024-11-01 18:25:24.150] [DEBUG] -- [{'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rereplication', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'server_permanent_offline_time', 'VALUE': '3600s'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.157', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rereplication', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'server_permanent_offline_time', 'VALUE': '3600s'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.161', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rereplication', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'server_permanent_offline_time', 'VALUE': '3600s'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}, {'SVR_IP': '10.1.250.160', 'SVR_PORT': 2882, 'NAME': 'enable_rebalance', 'VALUE': 'True'}] [2024-11-01 18:25:24.150] [INFO] Exec upgrade_checker.py [2024-11-01 18:25:24.151] [DEBUG] -- exec oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af upgrade_checker.py [2024-11-01 18:25:24.181] [DEBUG] -- exec oceanbase-ce-4.3.3.1-101000012024102216.el8-1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af upgrade_checker.py [2024-11-01 18:25:24.181] [DEBUG] -- local execute: /usr/obd/lib/executer/executer27/bin/executer /tmp/10.1.250.161:2882_10.1.250.160:2882_10.1.250.157:2882/1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af/upgrade_checker.py -h 10.1.250.161 -P 2881 -u root -p '******' [2024-11-01 18:25:35.765] [DEBUG] -- exited code 255, error output: [2024-11-01 18:25:35.766] [DEBUG] Character set '45' is not a compiled character set and is not specified in the '/usr/local/mysql/share/charsets/Index.xml' file [2024-11-01 18:25:35.766] [DEBUG] Character set '45' is not a compiled character set and is not specified in the '/usr/local/mysql/share/charsets/Index.xml' file [2024-11-01 18:25:35.766] [DEBUG] Traceback (most recent call last): [2024-11-01 18:25:35.766] [DEBUG] File "executer27.py", line 52, in [2024-11-01 18:25:35.766] [DEBUG] File "/tmp/10.1.250.161:2882_10.1.250.160:2882_10.1.250.157:2882/1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af/upgrade_checker.py", line 1060, in [2024-11-01 18:25:35.766] [DEBUG] do_check(host, port, user, password, timeout, upgrade_params, cpu_arch) [2024-11-01 18:25:35.766] [DEBUG] File "/tmp/10.1.250.161:2882_10.1.250.160:2882_10.1.250.157:2882/1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af/upgrade_checker.py", line 1024, in do_check [2024-11-01 18:25:35.766] [DEBUG] check_fail_list() [2024-11-01 18:25:35.766] [DEBUG] File "/tmp/10.1.250.161:2882_10.1.250.160:2882_10.1.250.157:2882/1e4fc2a7c9820f9bd94abb6bae2615db08cfe6af/upgrade_checker.py", line 740, in check_fail_list [2024-11-01 18:25:35.766] [DEBUG] raise MyError(error_msg) [2024-11-01 18:25:35.766] [DEBUG] __main__.MyError: 'upgrade checker failed with 1 reasons: [1 locality tasks is doing, please check] ' [2024-11-01 18:25:35.766] [DEBUG] [86761] Failed to execute script executer27 [2024-11-01 18:25:35.766] [DEBUG] [2024-11-01 18:25:35.889] [DEBUG] - sub upgrade ref count to 0 [2024-11-01 18:25:35.889] [DEBUG] - export upgrade [2024-11-01 18:25:35.889] [DEBUG] - plugin oceanbase-ce-py_script_upgrade-4.2.2.0 result: None [2024-11-01 18:25:35.889] [DEBUG] - dump upgrade meta data to /root/.obd/cluster/stagoceanbase7/.upgrade [2024-11-01 18:25:35.901] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2024-11-01 18:25:35.901] [INFO] Trace ID: 910f8f06-983b-11ef-b215-5254009652b5 [2024-11-01 18:25:35.901] [INFO] If you want to view detailed obd logs, please run: obd display-trace 910f8f06-983b-11ef-b215-5254009652b5 [2024-11-01 18:25:35.902] [DEBUG] - unlock /root/.obd/lock/global [2024-11-01 18:25:35.902] [DEBUG] - unlock /root/.obd/lock/deploy_stagoceanbase7 [2024-11-01 18:25:35.902] [DEBUG] - unlock /root/.obd/lock/mirror_and_repo