[2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - cmd: ['fvob'] [2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - opts: {'servers': None, 'components': None, 'with_parameter': None} [2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - mkdir /home/admin/.obd/lock/ [2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - unknown lock mode [2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/global [2024-01-12 15:59:18.026] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock `/home/admin/.obd/lock/global`, count 1 [2024-01-12 15:59:18.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Get Deploy by name [2024-01-12 15:59:18.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - mkdir /home/admin/.obd/cluster/ [2024-01-12 15:59:18.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - mkdir /home/admin/.obd/config_parser/ [2024-01-12 15:59:18.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - try to get exclusive lock /home/admin/.obd/lock/deploy_fvob [2024-01-12 15:59:18.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exclusive lock `/home/admin/.obd/lock/deploy_fvob`, count 1 [2024-01-12 15:59:18.035] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Deploy status judge [2024-01-12 15:59:18.037] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Get local repositories and plugins [2024-01-12 15:59:18.037] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - mkdir /home/admin/.obd/repository [2024-01-12 15:59:18.037] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Get local repository oceanbase-ce-4.2.1.3-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.038] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - try to get share lock /home/admin/.obd/lock/mirror_and_repo [2024-01-12 15:59:18.038] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 1 [2024-01-12 15:59:18.040] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Get local repository obproxy-ce-4.2.1.0-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.041] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 2 [2024-01-12 15:59:18.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Get local repository obagent-4.2.1-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 3 [2024-01-12 15:59:18.045] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Get local repository ocp-express-4.2.1-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.045] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock `/home/admin/.obd/lock/mirror_and_repo`, count 4 [2024-01-12 15:59:18.072] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching restart plugin for components ... [2024-01-12 15:59:18.073] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching restart plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.073] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - mkdir /home/admin/.obd/plugins [2024-01-12 15:59:18.077] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.077] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching restart plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.078] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.078] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching restart plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.081] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_restart-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.081] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching restart plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.081] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_restart-1.0 for ocp-express-4.2.1 [2024-01-12 15:59:18.081] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching reload plugin for components ... [2024-01-12 15:59:18.081] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching reload plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_reload-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching reload plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_reload-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching reload plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_reload-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching reload plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_reload-1.0 for ocp-express-4.2.1 [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start_check plugin for components ... [2024-01-12 15:59:18.082] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start_check plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.083] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.083] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start_check plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.083] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.083] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start_check plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start_check plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.1 [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start plugin for components ... [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_start-4.2.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.084] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_start-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching start plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_start-4.2.1 for ocp-express-4.2.1 [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching stop plugin for components ... [2024-01-12 15:59:18.085] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching stop plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching stop plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching stop plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_stop-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching stop plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_stop-1.0 for ocp-express-4.2.1 [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching connect plugin for components ... [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching connect plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching connect plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching connect plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_connect-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching connect plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:18.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching display plugin for components ... [2024-01-12 15:59:18.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching display plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching display plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching display plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_display-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching display plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching bootstrap plugin for components ... [2024-01-12 15:59:18.089] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching bootstrap plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_bootstrap-4.2.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching bootstrap plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching bootstrap plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.1 [2024-01-12 15:59:18.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching bootstrap plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:18.091] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:18.169] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Load cluster param plugin [2024-01-12 15:59:18.170] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching param plugin for components ... [2024-01-12 15:59:18.170] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Search param plugin for oceanbase-ce [2024-01-12 15:59:18.171] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-param-4.2.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:18.171] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Applying oceanbase-ce-param-4.2.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:18.666] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Search param plugin for obproxy-ce [2024-01-12 15:59:18.667] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:18.667] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:18.781] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Search param plugin for obagent [2024-01-12 15:59:18.782] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-param-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:18.782] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Applying obagent-param-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:18.839] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Search param plugin for ocp-express [2024-01-12 15:59:18.839] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-param-4.1.0 for ocp-express-4.2.1 [2024-01-12 15:59:18.839] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Applying ocp-express-param-4.1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:19.019] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Open ssh connection [2024-01-12 15:59:19.020] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - host: 192.166.0.87, port: 22, user: admin, password: hbis@1234 [2024-01-12 15:59:19.321] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - host: 192.166.0.89, port: 22, user: admin, password: hbis@1234 [2024-01-12 15:59:19.673] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Cluster status check [2024-01-12 15:59:19.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching status plugin for components ... [2024-01-12 15:59:19.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching status plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:19.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:19.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching status plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:19.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:19.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching status plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:19.676] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for obagent-py_script_status-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:19.676] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Searching status plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:19.676] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Found for ocp-express-py_script_status-1.0 for ocp-express-4.2.1 [2024-01-12 15:59:19.676] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:19.676] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import status [2024-01-12 15:59:19.678] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add status ref count to 1 [2024-01-12 15:59:19.678] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:19.734] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:19.735] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:19.833] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:19.833] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub status ref count to 0 [2024-01-12 15:59:19.833] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export status [2024-01-12 15:59:19.834] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:19.834] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import status [2024-01-12 15:59:19.835] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add status ref count to 1 [2024-01-12 15:59:19.835] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:19.892] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:19.893] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: ls /proc/13108 [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 2, error output: [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/13108': 没有那个文件或目录 [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub status ref count to 0 [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export status [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obagent-py_script_status-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:19.990] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import status [2024-01-12 15:59:19.991] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add status ref count to 1 [2024-01-12 15:59:19.992] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 15:59:20.048] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:20.048] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 15:59:20.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:20.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub status ref count to 0 [2024-01-12 15:59:20.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export status [2024-01-12 15:59:20.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call ocp-express-py_script_status-1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.147] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import status [2024-01-12 15:59:20.148] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add status ref count to 1 [2024-01-12 15:59:20.149] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:20.206] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:20.206] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: ls /proc/17076 [2024-01-12 15:59:20.306] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 2, error output: [2024-01-12 15:59:20.307] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/17076': 没有那个文件或目录 [2024-01-12 15:59:20.307] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:20.307] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub status ref count to 0 [2024-01-12 15:59:20.308] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export status [2024-01-12 15:59:20.308] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Deploy status inconsistent [2024-01-12 15:59:20.327] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Get deploy config [2024-01-12 15:59:20.328] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Search plugins [2024-01-12 15:59:20.328] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start_check plugin for components ... [2024-01-12 15:59:20.328] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start_check plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.329] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.329] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start_check plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.329] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.329] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start_check plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.329] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_start_check-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.330] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start_check plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.330] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.1 [2024-01-12 15:59:20.330] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching create_tenant plugin for components ... [2024-01-12 15:59:20.330] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching create_tenant plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_create_tenant-4.2.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching create_tenant plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- No such create_tenant plugin for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching create_tenant plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- No such create_tenant plugin for obagent-4.2.1 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching create_tenant plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- No such create_tenant plugin for ocp-express-4.2.1 [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start plugin for components ... [2024-01-12 15:59:20.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_start-4.2.0.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_start-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching start plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_start-4.2.1 for ocp-express-4.2.1 [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching connect plugin for components ... [2024-01-12 15:59:20.332] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching connect plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching connect plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching connect plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_connect-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching connect plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching bootstrap plugin for components ... [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching bootstrap plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.333] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_bootstrap-4.2.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching bootstrap plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching bootstrap plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_bootstrap-0.1 for obagent-4.2.1 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching bootstrap plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_bootstrap-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching display plugin for components ... [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching display plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching display plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.335] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching display plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.335] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_display-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.335] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching display plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.335] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_display-1.0.1 for ocp-express-4.2.1 [2024-01-12 15:59:20.466] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Load cluster param plugin [2024-01-12 15:59:20.466] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Get local repository oceanbase-ce-4.2.1.3-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.466] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Get local repository obproxy-ce-4.2.1.0-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.466] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Get local repository obagent-4.2.1-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.466] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Get local repository ocp-express-4.2.1-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.467] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching param plugin for components ... [2024-01-12 15:59:20.467] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Search param plugin for oceanbase-ce [2024-01-12 15:59:20.467] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-param-4.2.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.467] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Applying oceanbase-ce-param-4.2.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.467] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Search param plugin for obproxy-ce [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Applying obproxy-ce-param-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Search param plugin for obagent [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-param-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Applying obagent-param-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Search param plugin for ocp-express [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-param-4.1.0 for ocp-express-4.2.1 [2024-01-12 15:59:20.468] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Applying ocp-express-param-4.1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.599] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Cluster status check [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching status plugin for components ... [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching status plugin for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.1.3 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching status plugin for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.1.0 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching status plugin for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for obagent-py_script_status-1.3.0 for obagent-4.2.1 [2024-01-12 15:59:20.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Searching status plugin for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:20.601] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Found for ocp-express-py_script_status-1.0 for ocp-express-4.2.1 [2024-01-12 15:59:20.601] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_status-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:20.601] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:20.658] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:20.658] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:20.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:20.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_status-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:20.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:20.815] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:20.816] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/13108 [2024-01-12 15:59:20.915] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:20.915] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/13108': 没有那个文件或目录 [2024-01-12 15:59:20.915] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:20.916] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_status-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:20.916] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 15:59:20.971] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:20.971] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 15:59:21.069] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.069] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_status-1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:21.069] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:21.124] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.124] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/17076 [2024-01-12 15:59:21.223] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:21.224] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/17076': 没有那个文件或目录 [2024-01-12 15:59:21.224] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:21.224] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Deploy status inconsistent [2024-01-12 15:59:21.254] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:21.254] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start_check [2024-01-12 15:59:21.265] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start_check ref count to 1 [2024-01-12 15:59:21.266] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start observer [2024-01-12 15:59:21.267] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /home/admin/fvob/oceanbase/store/clog/tenant_1/ [2024-01-12 15:59:21.324] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.324] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:21.422] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.422] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:21.520] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.521] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 is runnning, skip [2024-01-12 15:59:21.521] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-01-12 15:59:21.618] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.618] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ulimit -a [2024-01-12 15:59:21.716] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /proc/meminfo [2024-01-12 15:59:21.815] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.816] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: df --block-size=1024 [2024-01-12 15:59:21.913] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /dev, total: 16168722432 avail: 16168722432 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /dev/shm, total: 16187801600 avail: 16187801600 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run, total: 16187801600 avail: 16169762816 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /sys/fs/cgroup, total: 16187801600 avail: 16187801600 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /, total: 464950538240 avail: 50828689408 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /tmp, total: 16187801600 avail: 16164978688 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /boot, total: 1063256064 avail: 871436288 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/0, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/991, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/1001, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:21.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- disk: {'/dev': {'total': 16168722432, 'avail': 16168722432, 'need': 0}, '/dev/shm': {'total': 16187801600, 'avail': 16187801600, 'need': 0}, '/run': {'total': 16187801600, 'avail': 16169762816, 'need': 0}, '/sys/fs/cgroup': {'total': 16187801600, 'avail': 16187801600, 'need': 0}, '/': {'total': 464950538240, 'avail': 50828689408, 'need': 0}, '/tmp': {'total': 16187801600, 'avail': 16164978688, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 871436288, 'need': 0}, '/run/user/0': {'total': 3237560320, 'avail': 3237560320, 'need': 0}, '/run/user/991': {'total': 3237560320, 'avail': 3237560320, 'need': 0}, '/run/user/1001': {'total': 3237560320, 'avail': 3237560320, 'need': 0}} [2024-01-12 15:59:21.915] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: date +%s%N [2024-01-12 15:59:22.012] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.012] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 time delta -1.05029296875 [2024-01-12 15:59:22.049] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start_check ref count to 0 [2024-01-12 15:59:22.049] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start_check [2024-01-12 15:59:22.049] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:22.049] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start_check [2024-01-12 15:59:22.052] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start_check ref count to 1 [2024-01-12 15:59:22.052] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start obproxy [2024-01-12 15:59:22.053] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:22.109] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.110] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/13108/fd [2024-01-12 15:59:22.208] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:22.208] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/13108/fd': 没有那个文件或目录 [2024-01-12 15:59:22.208] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:22.208] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 port check [2024-01-12 15:59:22.208] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:22.359] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.359] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:22.508] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start_check ref count to 0 [2024-01-12 15:59:22.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start_check [2024-01-12 15:59:22.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_start_check-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:22.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start_check [2024-01-12 15:59:22.578] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start_check ref count to 1 [2024-01-12 15:59:22.578] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start obagent [2024-01-12 15:59:22.580] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 15:59:22.636] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.636] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 15:59:22.734] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.734] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 is runnning, skip [2024-01-12 15:59:22.842] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start_check ref count to 0 [2024-01-12 15:59:22.842] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start_check [2024-01-12 15:59:22.842] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:22.842] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start_check [2024-01-12 15:59:22.847] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start_check ref count to 1 [2024-01-12 15:59:22.847] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start ocp-express [2024-01-12 15:59:22.849] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:22.905] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:22.906] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/17076 [2024-01-12 15:59:23.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:23.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/17076': 没有那个文件或目录 [2024-01-12 15:59:23.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:23.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:23.157] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.157] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: java -version [2024-01-12 15:59:23.421] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.422] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /proc/meminfo [2024-01-12 15:59:23.521] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.522] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: df --block-size=1024 [2024-01-12 15:59:23.620] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.620] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /dev, total: 16169848832 avail: 16169848832 [2024-01-12 15:59:23.620] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /dev/shm, total: 16188928000 avail: 16188928000 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run, total: 16188928000 avail: 16179347456 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /sys/fs/cgroup, total: 16188928000 avail: 16188928000 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /, total: 464950538240 avail: 412903927808 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /tmp, total: 16188928000 avail: 16099311616 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /boot, total: 1063256064 avail: 871436288 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/0, total: 3237785600 avail: 3237785600 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/992, total: 3237785600 avail: 3237785600 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /run/user/1001, total: 3237785600 avail: 3237785600 [2024-01-12 15:59:23.621] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: df --block-size=1024 /home/admin/fvob/ocpexpress/log [2024-01-12 15:59:23.719] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.719] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- get disk info for path /, total: 464950538240 avail: 412903927808 [2024-01-12 15:59:23.762] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start_check ref count to 0 [2024-01-12 15:59:23.762] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start_check [2024-01-12 15:59:23.762] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_start-4.2.0.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:23.762] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start [2024-01-12 15:59:23.765] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start ref count to 1 [2024-01-12 15:59:23.765] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start observer [2024-01-12 15:59:23.766] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /home/admin/fvob/oceanbase/store/clog/tenant_1/ [2024-01-12 15:59:23.822] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.823] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:23.922] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:23.923] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:24.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:24.027] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] observer program health check [2024-01-12 15:59:27.030] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 program health check [2024-01-12 15:59:27.030] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:27.086] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:27.087] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:27.186] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:27.186] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 observer[pid: 34503] started [2024-01-12 15:59:27.285] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start ref count to 0 [2024-01-12 15:59:27.285] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start [2024-01-12 15:59:27.285] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:27.285] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import connect [2024-01-12 15:59:27.288] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add connect ref count to 1 [2024-01-12 15:59:27.288] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to observer [2024-01-12 15:59:27.289] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- connect 192.166.0.89 -P2881 -uroot -pddRM.U4dKK3s49P&)d&A [2024-01-12 15:59:27.293] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- execute sql: select 1. args: None [2024-01-12 15:59:27.420] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub connect ref count to 0 [2024-01-12 15:59:27.420] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export connect [2024-01-12 15:59:27.420] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:27.420] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start [2024-01-12 15:59:27.423] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start ref count to 1 [2024-01-12 15:59:27.424] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start obproxy [2024-01-12 15:59:27.425] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /home/admin/fvob/obproxy/etc/obproxy_config.bin [2024-01-12 15:59:27.481] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:27.481] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 port check [2024-01-12 15:59:27.481] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:27.577] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:27.577] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/13108/ [2024-01-12 15:59:27.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:27.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/13108/': 没有那个文件或目录 [2024-01-12 15:59:27.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:27.674] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- starting 192.166.0.87 obproxy [2024-01-12 15:59:27.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 set env LD_LIBRARY_PATH to '/home/admin/fvob/obproxy/lib:' [2024-01-12 15:59:27.675] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cd /home/admin/fvob/obproxy; /home/admin/fvob/obproxy/bin/obproxy --listen_port 2883 [2024-01-12 15:59:27.847] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:27.848] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 delete env LD_LIBRARY_PATH [2024-01-12 15:59:27.848] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ps -aux | grep -e '/home/admin/fvob/obproxy/bin/obproxy --listen_port 2883$' | grep -v grep | awk '{print $2}' > /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:27.960] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:28.077] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obproxy program health check [2024-01-12 15:59:28.077] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:28.078] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:28.137] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:28.138] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:28.289] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:28.289] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 obproxy, remaining retries: 299 [2024-01-12 15:59:29.291] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:29.291] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:29.347] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:29.347] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:29.543] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:29.543] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 62768 [2024-01-12 15:59:29.543] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:29.544] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls -l /proc/10206/fd/ |grep -E 'socket:\[(62768)\]' [2024-01-12 15:59:29.668] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:29.669] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: pid=`cat /home/admin/fvob/obproxy/run/obproxyd-192.166.0.87-2883.pid` && ls /proc/$pid [2024-01-12 15:59:29.763] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:29.763] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/13079': 没有那个文件或目录 [2024-01-12 15:59:29.763] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:29.763] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: echo 10206 > /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:29.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:30.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - current remote_transporter RemoteTransporter.CLIENT [2024-01-12 15:59:30.006] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: mkdir -p /home/admin/fvob/obproxy && rm -fr /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 15:59:30.058] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:30.058] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 15:59:30.101] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - admin@192.166.0.87 execute: chmod 644 /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 15:59:30.155] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exited code 0 [2024-01-12 15:59:30.156] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash /home/admin/fvob/obproxy/obproxyd.sh /home/admin/fvob/obproxy 192.166.0.87 2883 [2024-01-12 15:59:30.252] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:31.253] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:31.254] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:31.308] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:31.308] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:31.453] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:31.453] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 obproxy, remaining retries: 297 [2024-01-12 15:59:32.454] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:32.454] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 15:59:32.506] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:32.506] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:32.648] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:32.648] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 64101 [2024-01-12 15:59:32.649] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:32.649] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls -l /proc/10931/fd/ |grep -E 'socket:\[(64101)\]' [2024-01-12 15:59:32.741] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:32.741] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: pid=`cat /home/admin/fvob/obproxy/run/obproxyd-192.166.0.87-2883.pid` && ls /proc/$pid [2024-01-12 15:59:32.833] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:32.834] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 obproxy[pid: 10931] started [2024-01-12 15:59:32.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start ref count to 0 [2024-01-12 15:59:32.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start [2024-01-12 15:59:32.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:32.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import connect [2024-01-12 15:59:32.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add connect ref count to 1 [2024-01-12 15:59:32.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to obproxy [2024-01-12 15:59:32.912] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- connect 192.166.0.87 -P2883 -uroot@proxysys -p2cIjxIZJVT [2024-01-12 15:59:33.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub connect ref count to 0 [2024-01-12 15:59:33.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export connect [2024-01-12 15:59:33.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_start-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:33.043] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start [2024-01-12 15:59:33.177] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start ref count to 1 [2024-01-12 15:59:33.187] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start obagent [2024-01-12 15:59:33.188] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 15:59:33.244] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:33.244] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 15:59:33.341] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:33.449] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obagent program health check [2024-01-12 15:59:34.451] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 program health check [2024-01-12 15:59:34.451] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 15:59:34.506] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:34.506] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_mgragent.pid [2024-01-12 15:59:34.605] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:34.605] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:34.756] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:34.756] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 155657 [2024-01-12 15:59:34.756] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:34.756] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.89 execute: ls -l /proc/37316/fd/ |grep -E 'socket:\[(155657)\]' [2024-01-12 15:59:34.855] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:34.855] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.89 obagent[pid: 37309] started [2024-01-12 15:59:34.856] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- start to sync target config [2024-01-12 15:59:34.883] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start ref count to 0 [2024-01-12 15:59:34.883] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start [2024-01-12 15:59:34.883] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_connect-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:34.883] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import connect [2024-01-12 15:59:34.885] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add connect ref count to 1 [2024-01-12 15:59:34.885] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to Obagent [2024-01-12 15:59:34.886] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- connect obagent (192.166.0.89:8089 by user admin) [2024-01-12 15:59:34.886] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send http request method: GET, url: http://192.166.0.89:8089/api/v1/agent/status, data: None [2024-01-12 15:59:35.020] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub connect ref count to 0 [2024-01-12 15:59:35.020] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export connect [2024-01-12 15:59:35.020] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_start-4.2.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:35.020] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import start [2024-01-12 15:59:35.060] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add start ref count to 1 [2024-01-12 15:59:35.073] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start ocp-express [2024-01-12 15:59:35.073] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:35.126] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.126] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/17076 [2024-01-12 15:59:35.218] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 2, error output: [2024-01-12 15:59:35.218] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/17076': 没有那个文件或目录 [2024-01-12 15:59:35.218] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:35.218] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /home/admin/fvob/ocpexpress/.bootstrapped [2024-01-12 15:59:35.310] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.311] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- connect 192.166.0.87 -P2883 -umeta@ocp -pjBRuJzuKlJ [2024-01-12 15:59:35.365] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 set env OCP_EXPRESS_INIT_PROPERTIES to ''{"cluster": {"name": "fvob", "obClusterId": 1704852306, "rootSysPassword": "ddRM.U4dKK3s49P&)d&A", "serverAddresses": [{"address": "192.166.0.89", "svrPort": 2882, "sqlPort": 2881, "withRootServer": true, "agentMgrPort": 8089, "agentMonPort": 8088}]}, "agentUsername": "admin", "agentPassword": "VqB0lxBHP5", "agentAuthType": "OCP_DIGEST"}'' [2024-01-12 15:59:35.365] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 set env OCP_EXPRESS_ADMIN_PASSWD to ''l_10Oy#W'' [2024-01-12 15:59:35.366] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 set env JDBC_PASSWORD to ''jBRuJzuKlJ'' [2024-01-12 15:59:35.366] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: cd /home/admin/fvob/ocpexpress; bash -c 'java -jar -Xms376m -Xmx376m -DJDBC_URL=jdbc:oceanbase://192.166.0.87:2883/ocp_express -DJDBC_USERNAME=meta@ocp -DPUBLIC_KEY= /home/admin/fvob/ocpexpress/lib/ocp-express-server.jar --port=8180 > /dev/null 2>&1 &' [2024-01-12 15:59:35.417] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.418] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ps -aux | grep 'java -jar -Xms376m -Xmx376m -DJDBC_URL=jdbc:oceanbase://192.166.0.87:2883/ocp_express -DJDBC_USERNAME=meta@ocp -DPUBLIC_KEY= /home/admin/fvob/ocpexpress/lib/ocp-express-server.jar --port=8180' | grep -v grep | awk '{print $2}' [2024-01-12 15:59:35.524] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.525] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- write 11573 to admin@192.166.0.87:22: /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:35.526] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: mkdir -p /home/admin/fvob/ocpexpress/run && rm -fr /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:35.623] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.623] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send /tmp/tmpxny_f8zc to /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:35.666] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - admin@192.166.0.87 execute: chmod 600 /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 15:59:35.743] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exited code 0 [2024-01-12 15:59:35.856] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] ocp-express program health check [2024-01-12 15:59:35.856] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:35.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:35.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:35.914] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:36.069] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:36.069] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 199 [2024-01-12 15:59:39.072] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:39.072] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:39.131] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:39.131] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:39.287] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:39.287] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 198 [2024-01-12 15:59:42.290] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:42.290] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:42.347] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:42.347] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:42.517] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:42.518] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 197 [2024-01-12 15:59:45.521] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:45.521] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:45.599] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:45.600] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:45.768] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:45.768] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 196 [2024-01-12 15:59:48.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:48.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:48.834] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:48.835] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:49.008] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:49.009] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 195 [2024-01-12 15:59:52.012] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:52.012] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:52.071] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:52.071] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:52.245] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:52.245] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- failed to start 192.166.0.87 ocp-express, remaining retries: 194 [2024-01-12 15:59:55.249] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 program health check [2024-01-12 15:59:55.249] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 15:59:55.307] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:55.307] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:55.460] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:55.460] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 69113 [2024-01-12 15:59:55.460] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:55.460] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- admin@192.166.0.87 execute: ls -l /proc/11573/fd/ |grep -E 'socket:\[(69113)\]' [2024-01-12 15:59:55.559] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- exited code 0 [2024-01-12 15:59:55.559] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- 192.166.0.87 ocp-express[pid: 11573] started [2024-01-12 15:59:55.573] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub start ref count to 0 [2024-01-12 15:59:55.573] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export start [2024-01-12 15:59:55.574] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_connect-1.0.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:55.574] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import connect [2024-01-12 15:59:55.576] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add connect ref count to 1 [2024-01-12 15:59:55.577] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to ocp-express [2024-01-12 15:59:55.577] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- connect ocp-express (192.166.0.87:8180 by user system) [2024-01-12 15:59:55.577] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send http request method: GET, url: http://192.166.0.87:8180/api/v1/status, data: None [2024-01-12 15:59:55.710] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub connect ref count to 0 [2024-01-12 15:59:55.710] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export connect [2024-01-12 15:59:55.710] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:55.710] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import display [2024-01-12 15:59:55.712] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add display ref count to 1 [2024-01-12 15:59:55.712] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Wait for observer init [2024-01-12 15:59:55.713] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- execute sql: select * from oceanbase.__all_server. args: None [2024-01-12 15:59:55.844] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub display ref count to 0 [2024-01-12 15:59:55.844] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export display [2024-01-12 15:59:55.844] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 15:59:55.844] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import display [2024-01-12 15:59:55.845] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add display ref count to 1 [2024-01-12 15:59:55.846] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- execute sql: show proxyconfig like "%port". args: None [2024-01-12 15:59:55.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub display ref count to 0 [2024-01-12 15:59:55.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export display [2024-01-12 15:59:55.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_display-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 15:59:55.857] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import display [2024-01-12 15:59:55.859] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add display ref count to 1 [2024-01-12 15:59:55.859] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send http request method: GET, url: http://192.166.0.89:8089/api/v1/agent/status, data: None [2024-01-12 15:59:55.889] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub display ref count to 0 [2024-01-12 15:59:55.889] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export display [2024-01-12 15:59:55.889] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_display-1.0.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 15:59:55.889] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- import display [2024-01-12 15:59:55.890] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- add display ref count to 1 [2024-01-12 15:59:55.891] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- send http request method: GET, url: http://192.166.0.87:8180/api/v1/status, data: None [2024-01-12 15:59:55.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- sub display ref count to 0 [2024-01-12 15:59:55.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- export display [2024-01-12 15:59:55.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Set fvob deploy status to running [2024-01-12 15:59:55.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - dump deploy info to /home/admin/.obd/cluster/fvob/.data [2024-01-12 15:59:55.901] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call oceanbase-ce-py_script_start_check-4.2.0.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:55.902] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before restart observer [2024-01-12 15:59:55.903] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ls /home/admin/fvob/oceanbase/store/clog/tenant_1/ [2024-01-12 15:59:55.959] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:55.959] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:56.059] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.059] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ls /proc/34503 [2024-01-12 15:59:56.162] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.162] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- 192.166.0.89 is runnning, skip [2024-01-12 15:59:56.162] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /proc/sys/fs/aio-max-nr /proc/sys/fs/aio-nr [2024-01-12 15:59:56.262] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.262] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ulimit -a [2024-01-12 15:59:56.364] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.365] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: sysctl -a [2024-01-12 15:59:56.484] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.487] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /proc/meminfo [2024-01-12 15:59:56.583] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.583] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: df --block-size=1024 [2024-01-12 15:59:56.682] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /dev, total: 16168722432 avail: 16168722432 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /dev/shm, total: 16187801600 avail: 16187801600 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run, total: 16187801600 avail: 16169758720 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 16187801600 avail: 16187801600 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /, total: 464950538240 avail: 50824003584 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /tmp, total: 16187801600 avail: 16164978688 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 871436288 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/0, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/991, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:56.683] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/1001, total: 3237560320 avail: 3237560320 [2024-01-12 15:59:56.684] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- disk: {'/dev': {'total': 16168722432, 'avail': 16168722432, 'need': 0}, '/dev/shm': {'total': 16187801600, 'avail': 16187801600, 'need': 0}, '/run': {'total': 16187801600, 'avail': 16169758720, 'need': 0}, '/sys/fs/cgroup': {'total': 16187801600, 'avail': 16187801600, 'need': 0}, '/': {'total': 464950538240, 'avail': 50824003584, 'need': 0}, '/tmp': {'total': 16187801600, 'avail': 16164978688, 'need': 0}, '/boot': {'total': 1063256064, 'avail': 871436288, 'need': 0}, '/run/user/0': {'total': 3237560320, 'avail': 3237560320, 'need': 0}, '/run/user/991': {'total': 3237560320, 'avail': 3237560320, 'need': 0}, '/run/user/1001': {'total': 3237560320, 'avail': 3237560320, 'need': 0}} [2024-01-12 15:59:56.684] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: date +%s%N [2024-01-12 15:59:56.785] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 15:59:56.785] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- 192.166.0.89 time delta -1.031494140625 [2024-01-12 15:59:56.816] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call oceanbase-ce-py_script_restart-4.0.0.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:56.816] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import restart [2024-01-12 15:59:56.820] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add restart ref count to 1 [2024-01-12 15:59:56.820] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to observer [2024-01-12 15:59:56.821] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:56.821] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect 192.166.0.89 -P2881 -uroot -pddRM.U4dKK3s49P&)d&A [2024-01-12 15:59:56.824] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select 1. args: None [2024-01-12 15:59:56.952] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 15:59:56.954] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: set session ob_query_timeout=1000000000. args: None [2024-01-12 15:59:56.956] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Server check [2024-01-12 15:59:56.957] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select * from oceanbase.__all_server. args: None [2024-01-12 15:59:56.958] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- [{'gmt_create': datetime.datetime(2024, 1, 10, 10, 8, 9, 461835), 'gmt_modified': datetime.datetime(2024, 1, 12, 15, 0, 27, 759934), 'svr_ip': '192.166.0.89', 'svr_port': 2882, 'id': 1, 'zone': 'zone1', 'inner_port': 2881, 'with_rootserver': 1, 'status': 'ACTIVE', 'block_migrate_in_time': 0, 'build_version': '4.2.1.3_103000032023122818-8fe69c2056b07154bbd1ebd2c26e818ee0d5c56f(Dec 28 2023 19:07:15)', 'stop_time': 0, 'start_service_time': 1705042826282652, 'first_sessid': 0, 'with_partition': 1, 'last_offline_time': 0}] [2024-01-12 15:59:57.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Observer restart [2024-01-12 15:59:57.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_stop-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:57.088] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- import stop [2024-01-12 15:59:57.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- add stop ref count to 1 [2024-01-12 15:59:57.090] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:57.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:57.146] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ps uax | egrep " 34503 " | grep -v grep [2024-01-12 15:59:57.257] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:57.258] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 observer[pid:34503] stopping ... [2024-01-12 15:59:57.258] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: kill -9 34503 [2024-01-12 15:59:57.361] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:58.362] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 check whether the port is released [2024-01-12 15:59:58.363] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B42' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:58.473] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:58.474] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B41' | awk -F' ' '{print $2}' | uniq [2024-01-12 15:59:58.619] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:58.620] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: rm -f /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:58.716] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:58.716] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 observer is stopped [2024-01-12 15:59:58.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- sub stop ref count to 0 [2024-01-12 15:59:58.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- export stop [2024-01-12 15:59:58.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_start-4.2.0.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 15:59:58.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /home/admin/fvob/oceanbase/store/clog/tenant_1/ [2024-01-12 15:59:58.813] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:58.813] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 15:59:58.910] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 15:59:58.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/oceanbase/run/observer.pid: 没有那个文件或目录 [2024-01-12 15:59:58.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 15:59:58.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 start command construction [2024-01-12 15:59:58.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /home/admin/fvob/oceanbase/etc/observer.config.bin [2024-01-12 15:59:59.008] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:59.008] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- starting 192.166.0.89 observer [2024-01-12 15:59:59.009] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 set env LD_LIBRARY_PATH to '/home/admin/fvob/oceanbase/lib:' [2024-01-12 15:59:59.009] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cd /home/admin/fvob/oceanbase; /home/admin/fvob/oceanbase/bin/observer -p 2881 [2024-01-12 15:59:59.158] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 15:59:59.158] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 delete env LD_LIBRARY_PATH [2024-01-12 16:00:02.162] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 program health check [2024-01-12 16:00:02.162] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/oceanbase/run/observer.pid [2024-01-12 16:00:02.220] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:02.220] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /proc/52336 [2024-01-12 16:00:02.326] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:02.326] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 observer[pid: 52336] started [2024-01-12 16:00:02.327] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_connect-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 16:00:02.327] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect 192.166.0.89 -P2881 -uroot -pddRM.U4dKK3s49P&)d&A [2024-01-12 16:00:05.334] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect 192.166.0.89 -P2881 -uroot -p [2024-01-12 16:00:05.339] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select 1. args: None [2024-01-12 16:00:05.343] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:05.346] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:07.349] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:07.352] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:09.353] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:09.355] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:11.357] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:11.359] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:13.361] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:13.363] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:15.365] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:15.367] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- OBD-5000: use oceanbase execute failed [2024-01-12 16:00:17.370] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: use oceanbase. args: None [2024-01-12 16:00:17.374] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: set session ob_query_timeout=1000000000. args: None [2024-01-12 16:00:17.376] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- server check [2024-01-12 16:00:17.376] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select * from oceanbase.__all_server where status != 'active' or stop_time > 0 or start_service_time = 0. args: None [2024-01-12 16:00:17.426] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select version(). args: None [2024-01-12 16:00:17.429] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- {'version()': '5.7.25-OceanBase_CE-v4.2.1.3'} [2024-01-12 16:00:17.429] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call oceanbase-ce-py_script_display-3.1.0 for oceanbase-ce-4.2.1.3-103000032023122818.el8-e9fb4c64e1727efa25f82b0103c1b826d5dbec53 [2024-01-12 16:00:17.429] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Wait for observer init [2024-01-12 16:00:17.430] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: select * from oceanbase.__all_server. args: None [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +------------------------------------------------+ [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | observer | [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | ip | version | port | zone | status | [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | 192.166.0.89 | 4.2.1.3 | 2881 | zone1 | ACTIVE | [2024-01-12 16:00:17.433] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.434] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obclient -h192.166.0.89 -P2881 -uroot -p'ddRM.U4dKK3s49P&)d&A' -Doceanbase -A [2024-01-12 16:00:17.560] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +------------------------------------------------+ [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | observer | [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | ip | version | port | zone | status | [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | 192.166.0.89 | 4.2.1.3 | 2881 | zone1 | ACTIVE | [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+---------+------+-------+--------+ [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obclient -h192.166.0.89 -P2881 -uroot -p'ddRM.U4dKK3s49P&)d&A' -Doceanbase -A [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub restart ref count to 0 [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export restart [2024-01-12 16:00:17.561] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obproxy-ce-py_script_start_check-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:17.562] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start obproxy [2024-01-12 16:00:17.562] [7c763750-b120-11ee-b73f-00163e57d3e4] [WARNING] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce [2024-01-12 16:00:17.562] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:17.617] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:17.617] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: ls /proc/10931/fd [2024-01-12 16:00:17.712] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:17.712] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- 192.166.0.87 is runnning, skip [2024-01-12 16:00:17.824] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] [WARN] OBD-4521: The config observer_sys_password in obproxy-ce did not take effect, please config it in oceanbase-ce [2024-01-12 16:00:17.824] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] [2024-01-12 16:00:17.824] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obproxy-ce-py_script_restart-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:17.824] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import restart [2024-01-12 16:00:17.828] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add restart ref count to 1 [2024-01-12 16:00:17.828] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_stop-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:17.828] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- import stop [2024-01-12 16:00:17.831] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- add stop ref count to 1 [2024-01-12 16:00:17.831] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Stop obproxy [2024-01-12 16:00:17.832] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:17.885] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:17.885] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/10931 [2024-01-12 16:00:17.979] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:17.979] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/10931/fd [2024-01-12 16:00:18.074] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:18.074] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 obproxy[pid:10931] stopping ... [2024-01-12 16:00:18.074] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxyd-192.166.0.87-2883.pid | xargs kill -9; kill -9 -10931 [2024-01-12 16:00:18.169] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.171] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 check whether the port is released [2024-01-12 16:00:19.171] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B44' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:19.278] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.278] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:19.430] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.431] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: rm -f /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:19.527] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.528] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 obproxy is stopped [2024-01-12 16:00:19.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- sub stop ref count to 0 [2024-01-12 16:00:19.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- export stop [2024-01-12 16:00:19.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_start-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:19.661] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start obproxy [2024-01-12 16:00:19.661] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /home/admin/fvob/obproxy/etc/obproxy_config.bin [2024-01-12 16:00:19.716] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 port check [2024-01-12 16:00:19.717] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:19.811] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 16:00:19.811] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid: 没有那个文件或目录 [2024-01-12 16:00:19.811] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:19.812] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- starting 192.166.0.87 obproxy [2024-01-12 16:00:19.812] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 set env LD_LIBRARY_PATH to '/home/admin/fvob/obproxy/lib:' [2024-01-12 16:00:19.812] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cd /home/admin/fvob/obproxy; /home/admin/fvob/obproxy/bin/obproxy -o obproxy_sys_password='077aacb98b22bc1ce509f3c2625e6c042184521b',enable_strict_kernel_release=False,proxy_mem_limited='4GB',skip_proxy_sys_private_check=True,enable_cluster_checkout=False --listen_port 2883 --prometheus_listen_port 2884 --rs_list '192.166.0.89:2881' --cluster_name 'fvob' [2024-01-12 16:00:19.918] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:19.918] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 delete env LD_LIBRARY_PATH [2024-01-12 16:00:19.918] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ps -aux | grep -e '/home/admin/fvob/obproxy/bin/obproxy -o obproxy_sys_password=077aacb98b22bc1ce509f3c2625e6c042184521b,enable_strict_kernel_release=False,proxy_mem_limited=4GB,skip_proxy_sys_private_check=True,enable_cluster_checkout=False --listen_port 2883 --prometheus_listen_port 2884 --rs_list 192.166.0.89:2881 --cluster_name fvob$' | grep -v grep | awk '{print $2}' > /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:20.028] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:20.054] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obproxy program health check [2024-01-12 16:00:20.054] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:20.055] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:20.122] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:20.123] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:20.275] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:20.276] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- failed to start 192.166.0.87 obproxy, remaining retries: 299 [2024-01-12 16:00:21.277] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:21.277] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:21.330] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:21.331] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:21.478] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:21.479] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 74034 [2024-01-12 16:00:21.479] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:21.479] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls -l /proc/13500/fd/ |grep -E 'socket:\[(74034)\]' [2024-01-12 16:00:21.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:21.575] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: pid=`cat /home/admin/fvob/obproxy/run/obproxyd-192.166.0.87-2883.pid` && ls /proc/$pid [2024-01-12 16:00:21.671] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 2, error output: [2024-01-12 16:00:21.671] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/10905': 没有那个文件或目录 [2024-01-12 16:00:21.671] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:21.672] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: echo 13500 > /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:21.764] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:21.765] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: mkdir -p /home/admin/fvob/obproxy && rm -fr /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 16:00:21.860] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:21.861] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- send /home/admin/.obd/plugins/obproxy-ce/3.1.0/obproxyd.sh to /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 16:00:21.904] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - admin@192.166.0.87 execute: chmod 644 /home/admin/fvob/obproxy/obproxyd.sh [2024-01-12 16:00:21.957] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exited code 0 [2024-01-12 16:00:21.957] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash /home/admin/fvob/obproxy/obproxyd.sh /home/admin/fvob/obproxy 192.166.0.87 2883 [2024-01-12 16:00:22.054] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:23.056] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:23.056] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:23.111] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:23.112] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:23.261] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:23.262] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- failed to start 192.166.0.87 obproxy, remaining retries: 297 [2024-01-12 16:00:24.263] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:24.263] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/obproxy/run/obproxy-192.166.0.87-2883.pid [2024-01-12 16:00:24.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:24.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:0B43' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:24.471] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:24.471] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 71161 [2024-01-12 16:00:24.471] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:24.471] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls -l /proc/14125/fd/ |grep -E 'socket:\[(71161)\]' [2024-01-12 16:00:24.571] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:24.572] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: pid=`cat /home/admin/fvob/obproxy/run/obproxyd-192.166.0.87-2883.pid` && ls /proc/$pid [2024-01-12 16:00:24.669] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:24.669] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 obproxy[pid: 14125] started [2024-01-12 16:00:24.748] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to obproxy [2024-01-12 16:00:24.748] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_connect-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:24.749] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect 192.166.0.87 -P2883 -uroot@proxysys -p2cIjxIZJVT [2024-01-12 16:00:24.880] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_bootstrap-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:24.880] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- import bootstrap [2024-01-12 16:00:24.882] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- add bootstrap ref count to 1 [2024-01-12 16:00:24.882] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: alter proxyconfig set observer_sys_password = %s. args: ['feYLHLd3CL'] [2024-01-12 16:00:24.890] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- sub bootstrap ref count to 0 [2024-01-12 16:00:24.890] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- export bootstrap [2024-01-12 16:00:24.890] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obproxy-ce-py_script_display-3.1.0 for obproxy-ce-4.2.1.0-11.el8-6b1c8edcc1606189c94090acd2131e73899d1a61 [2024-01-12 16:00:24.890] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- execute sql: show proxyconfig like "%port". args: None [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +------------------------------------------------+ [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | obproxy | [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+------+-----------------+--------+ [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | ip | port | prometheus_port | status | [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+------+-----------------+--------+ [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | 192.166.0.87 | 2883 | 2884 | active | [2024-01-12 16:00:24.898] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+------+-----------------+--------+ [2024-01-12 16:00:24.899] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obclient -h192.166.0.87 -P2883 -uroot -p'ddRM.U4dKK3s49P&)d&A' -Doceanbase -A [2024-01-12 16:00:24.899] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] [2024-01-12 16:00:24.899] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub restart ref count to 0 [2024-01-12 16:00:24.899] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export restart [2024-01-12 16:00:24.899] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obagent-py_script_start_check-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:24.900] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start obagent [2024-01-12 16:00:24.901] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:24.959] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:24.959] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 16:00:25.057] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:25.058] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- 192.166.0.89 is runnning, skip [2024-01-12 16:00:25.163] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call obagent-py_script_restart-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:25.163] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import restart [2024-01-12 16:00:25.165] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add restart ref count to 1 [2024-01-12 16:00:25.165] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_stop-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:25.166] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- import stop [2024-01-12 16:00:25.167] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- add stop ref count to 1 [2024-01-12 16:00:25.167] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Stop obagent [2024-01-12 16:00:25.168] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:25.223] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:25.223] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 obagentd[pid:37309] stopping ... [2024-01-12 16:00:25.223] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: kill -9 37309 [2024-01-12 16:00:25.320] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:25.321] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_monagent.pid [2024-01-12 16:00:25.418] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:25.418] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 monagent[pid:37317] stopping ... [2024-01-12 16:00:25.418] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: kill -9 37317 [2024-01-12 16:00:25.515] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:25.515] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_mgragent.pid [2024-01-12 16:00:25.614] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:25.615] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 mgragent[pid:37316] stopping ... [2024-01-12 16:00:25.615] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: kill -9 37316 [2024-01-12 16:00:25.712] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:26.713] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 check whether the port is released [2024-01-12 16:00:26.713] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /proc/37309 [2024-01-12 16:00:26.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 2, error output: [2024-01-12 16:00:26.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/37309': 没有那个文件或目录 [2024-01-12 16:00:26.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:26.771] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: rm -f /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:26.870] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:26.871] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /proc/37317 [2024-01-12 16:00:26.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 2, error output: [2024-01-12 16:00:26.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/37317': 没有那个文件或目录 [2024-01-12 16:00:26.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:26.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:27.121] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:27.121] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: rm -f /home/admin/fvob/obagent/run/ob_monagent.pid [2024-01-12 16:00:27.219] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:27.219] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /proc/37316 [2024-01-12 16:00:27.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 2, error output: [2024-01-12 16:00:27.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/37316': 没有那个文件或目录 [2024-01-12 16:00:27.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:27.319] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:27.470] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:27.471] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: rm -f /home/admin/fvob/obagent/run/ob_mgragent.pid [2024-01-12 16:00:27.569] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:27.569] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 obagent is stopped [2024-01-12 16:00:27.645] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- sub stop ref count to 0 [2024-01-12 16:00:27.645] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- export stop [2024-01-12 16:00:27.645] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_start_check-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:27.646] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start obagent [2024-01-12 16:00:27.647] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:27.703] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 16:00:27.703] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/obagent/run/ob_agentd.pid: 没有那个文件或目录 [2024-01-12 16:00:27.703] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:27.703] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 port check [2024-01-12 16:00:27.703] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:27.854] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:27.854] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F98' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:28.002] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:28.039] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_start-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:28.047] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start obagent [2024-01-12 16:00:28.047] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:28.102] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 16:00:28.102] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/obagent/run/ob_agentd.pid: 没有那个文件或目录 [2024-01-12 16:00:28.102] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:28.102] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls /home/admin/fvob/obagent/.configured [2024-01-12 16:00:28.202] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:28.203] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cd /home/admin/fvob/obagent;/home/admin/fvob/obagent/bin/ob_agentctl start [2024-01-12 16:00:29.346] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:29.351] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] obagent program health check [2024-01-12 16:00:30.352] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 program health check [2024-01-12 16:00:30.353] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_agentd.pid [2024-01-12 16:00:30.409] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:30.409] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: cat /home/admin/fvob/obagent/run/ob_mgragent.pid [2024-01-12 16:00:30.507] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:30.508] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1F99' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:30.658] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:30.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 243797 [2024-01-12 16:00:30.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:30.659] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.89 execute: ls -l /proc/55119/fd/ |grep -E 'socket:\[(243797)\]' [2024-01-12 16:00:30.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:30.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.89 obagent[pid: 55113] started [2024-01-12 16:00:30.759] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- start to sync target config [2024-01-12 16:00:30.785] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_connect-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:30.785] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Connect to Obagent [2024-01-12 16:00:30.786] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect obagent (192.166.0.89:8089 by user admin) [2024-01-12 16:00:30.786] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- send http request method: GET, url: http://192.166.0.89:8089/api/v1/agent/status, data: None [2024-01-12 16:00:30.917] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call obagent-py_script_display-1.3.0 for obagent-4.2.1-100000122023103020.el8-668081831d6371e63e3950dd978f5c613741d063 [2024-01-12 16:00:30.918] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- send http request method: GET, url: http://192.166.0.89:8089/api/v1/agent/status, data: None [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +-----------------------------------------------------------------+ [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | obagent | [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+--------------------+--------------------+--------+ [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | ip | mgragent_http_port | monagent_http_port | status | [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+--------------------+--------------------+--------+ [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] | 192.166.0.89 | 8089 | 8088 | active | [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] +--------------+--------------------+--------------------+--------+ [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub restart ref count to 0 [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export restart [2024-01-12 16:00:30.947] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 16:00:30.948] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start ocp-express [2024-01-12 16:00:30.949] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:31.003] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.003] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 16:00:31.097] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.097] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- 192.166.0.87 is running, skip [2024-01-12 16:00:31.097] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: java -version [2024-01-12 16:00:31.249] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.249] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: cat /proc/meminfo [2024-01-12 16:00:31.344] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.344] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: df --block-size=1024 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /dev, total: 16169848832 avail: 16169848832 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /dev/shm, total: 16188928000 avail: 16188928000 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run, total: 16188928000 avail: 16179347456 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /sys/fs/cgroup, total: 16188928000 avail: 16188928000 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /, total: 464950538240 avail: 412899438592 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /tmp, total: 16188928000 avail: 16099278848 [2024-01-12 16:00:31.436] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /boot, total: 1063256064 avail: 871436288 [2024-01-12 16:00:31.437] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/0, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:31.437] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/992, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:31.437] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /run/user/1001, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:31.437] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- admin@192.166.0.87 execute: df --block-size=1024 /home/admin/fvob/ocpexpress/log [2024-01-12 16:00:31.527] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- exited code 0 [2024-01-12 16:00:31.527] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- get disk info for path /, total: 464950538240 avail: 412899438592 [2024-01-12 16:00:31.601] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - Call ocp-express-py_script_restart-1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 16:00:31.602] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - import restart [2024-01-12 16:00:31.604] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - add restart ref count to 1 [2024-01-12 16:00:31.604] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_stop-1.0 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 16:00:31.604] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- import stop [2024-01-12 16:00:31.605] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- add stop ref count to 1 [2024-01-12 16:00:31.606] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Stop ocp-express [2024-01-12 16:00:31.606] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:31.656] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:31.656] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/11573 [2024-01-12 16:00:31.747] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:31.748] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/11573/fd [2024-01-12 16:00:31.844] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:31.845] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 ocp-express[pid: 11573] stopping... [2024-01-12 16:00:31.845] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: kill -9 11573 [2024-01-12 16:00:31.949] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:32.950] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 check whether the port is released [2024-01-12 16:00:32.950] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:33.055] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.056] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: rm -rf /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:33.152] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.152] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 ocp-express is stopped [2024-01-12 16:00:33.170] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- sub stop ref count to 0 [2024-01-12 16:00:33.170] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] --- export stop [2024-01-12 16:00:33.170] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_start_check-4.2.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 16:00:33.171] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Check before start ocp-express [2024-01-12 16:00:33.172] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:33.246] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 16:00:33.246] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/ocpexpress/run/ocp-express.pid: 没有那个文件或目录 [2024-01-12 16:00:33.246] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:33.247] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{udp*,tcp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:33.399] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.400] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: java -version [2024-01-12 16:00:33.550] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.551] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /proc/meminfo [2024-01-12 16:00:33.646] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.646] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: df --block-size=1024 [2024-01-12 16:00:33.744] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.744] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /dev, total: 16169848832 avail: 16169848832 [2024-01-12 16:00:33.744] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /dev/shm, total: 16188928000 avail: 16188928000 [2024-01-12 16:00:33.744] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /run, total: 16188928000 avail: 16179347456 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /sys/fs/cgroup, total: 16188928000 avail: 16188928000 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /, total: 464950538240 avail: 412899454976 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /tmp, total: 16188928000 avail: 16099311616 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /boot, total: 1063256064 avail: 871436288 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /run/user/0, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /run/user/992, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /run/user/1001, total: 3237785600 avail: 3237785600 [2024-01-12 16:00:33.745] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: df --block-size=1024 /home/admin/fvob/ocpexpress/log [2024-01-12 16:00:33.840] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:33.841] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- get disk info for path /, total: 464950538240 avail: 412899454976 [2024-01-12 16:00:33.955] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] -- Call ocp-express-py_script_start-4.2.1 for ocp-express-4.2.1-100000222023111619.el8-60fe0791fa13f437b26a23e3c5fc960d0fafbc7c [2024-01-12 16:00:33.971] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Start ocp-express [2024-01-12 16:00:33.971] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cat /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:34.034] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 1, error output: [2024-01-12 16:00:34.035] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] cat: /home/admin/fvob/ocpexpress/run/ocp-express.pid: 没有那个文件或目录 [2024-01-12 16:00:34.035] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:34.035] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /home/admin/fvob/ocpexpress/.bootstrapped [2024-01-12 16:00:34.133] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.134] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- connect 192.166.0.87 -P2883 -umeta@ocp -pjBRuJzuKlJ [2024-01-12 16:00:34.139] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 append ''{"cluster": {"name": "fvob", "obClusterId": 1704852306, "rootSysPassword": "ddRM.U4dKK3s49P&)d&A", "serverAddresses": [{"address": "192.166.0.89", "svrPort": 2882, "sqlPort": 2881, "withRootServer": true, "agentMgrPort": 8089, "agentMonPort": 8088}]}, "agentUsername": "admin", "agentPassword": "VqB0lxBHP5", "agentAuthType": "OCP_DIGEST"}'' to OCP_EXPRESS_INIT_PROPERTIES [2024-01-12 16:00:34.139] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 append ''l_10Oy#W'' to OCP_EXPRESS_ADMIN_PASSWD [2024-01-12 16:00:34.139] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 append ''jBRuJzuKlJ'' to JDBC_PASSWORD [2024-01-12 16:00:34.139] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: cd /home/admin/fvob/ocpexpress; bash -c 'java -jar -Xms376m -Xmx376m -DJDBC_URL=jdbc:oceanbase://192.166.0.87:2883/ocp_express -DJDBC_USERNAME=meta@ocp -DPUBLIC_KEY= /home/admin/fvob/ocpexpress/lib/ocp-express-server.jar --port=8180 > /dev/null 2>&1 &' [2024-01-12 16:00:34.232] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.232] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ps -aux | grep 'java -jar -Xms376m -Xmx376m -DJDBC_URL=jdbc:oceanbase://192.166.0.87:2883/ocp_express -DJDBC_USERNAME=meta@ocp -DPUBLIC_KEY= /home/admin/fvob/ocpexpress/lib/ocp-express-server.jar --port=8180' | grep -v grep | awk '{print $2}' [2024-01-12 16:00:34.407] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.408] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- write 15669 to admin@192.166.0.87:22: /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:34.408] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: mkdir -p /home/admin/fvob/ocpexpress/run && rm -fr /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:34.517] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.518] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- send /tmp/tmp06ngkpy_ to /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:34.559] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - admin@192.166.0.87 execute: chmod 600 /home/admin/fvob/ocpexpress/run/ocp-express.pid [2024-01-12 16:00:34.619] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exited code 0 [2024-01-12 16:00:34.628] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] ocp-express program health check [2024-01-12 16:00:34.628] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:34.628] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/15669 [2024-01-12 16:00:34.740] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.740] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: bash -c 'cat /proc/net/{tcp*,udp*}' | awk -F' ' '{print $2,$10}' | grep '00000000:1FF4' | awk -F' ' '{print $2}' | uniq [2024-01-12 16:00:34.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 0 [2024-01-12 16:00:34.908] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- failed to start 192.166.0.87 ocp-express, remaining retries: 199 [2024-01-12 16:00:37.911] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- 192.166.0.87 program health check [2024-01-12 16:00:37.912] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- admin@192.166.0.87 execute: ls /proc/15669 [2024-01-12 16:00:37.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ---- exited code 2, error output: [2024-01-12 16:00:37.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] ls: 无法访问 '/proc/15669': 没有那个文件或目录 [2024-01-12 16:00:37.970] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] [2024-01-12 16:00:38.018] [7c763750-b120-11ee-b73f-00163e57d3e4] [ERROR] failed to start 192.166.0.87 ocp-express [2024-01-12 16:00:38.018] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - sub restart ref count to 0 [2024-01-12 16:00:38.018] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - export restart [2024-01-12 16:00:38.022] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] See https://www.oceanbase.com/product/ob-deployer/error-codes . [2024-01-12 16:00:38.022] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] Trace ID: 7c763750-b120-11ee-b73f-00163e57d3e4 [2024-01-12 16:00:38.022] [7c763750-b120-11ee-b73f-00163e57d3e4] [INFO] If you want to view detailed obd logs, please run: obd display-trace 7c763750-b120-11ee-b73f-00163e57d3e4 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 3 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 2 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 1 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock /home/admin/.obd/lock/mirror_and_repo release, count 0 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - unlock /home/admin/.obd/lock/mirror_and_repo [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - exclusive lock /home/admin/.obd/lock/deploy_fvob release, count 0 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - unlock /home/admin/.obd/lock/deploy_fvob [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - share lock /home/admin/.obd/lock/global release, count 0 [2024-01-12 16:00:38.023] [7c763750-b120-11ee-b73f-00163e57d3e4] [DEBUG] - unlock /home/admin/.obd/lock/global