insert百万级别的数据需要十几分钟

OceanBase
#1

【 使用环境 】生产环境
【 OB or 其他组件 】ob
【 使用版本 】4.0
【问题描述】
简单重复执行的sql插入，插入量级为百万级
ocp观察单条sql插入只需要0.35ms
执行时发现每条需要280ms

image
image1998×1550 207 KB

sql如下
insert into
widenetwork.pppoe_User (
facility,
isdx,
node_number,
oltip,
oltjx,
oltpon,
phone,
qyId,
qzdsphone,
serialNumber,
username,
whry,
whwg,
whwgId,
xq,
zjdz,
id
)
values
(
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?,
?
)
怀疑是插入时，日志同步问题导入的，想问下，老师，怎么处理下这种问题？

#3

你好，可以安装下sql diagnose 诊断工具，收集下信息，有助于快速分析。https://www.oceanbase.com/docs/community-observer-cn-10000000000449598

#4

我已经安装ocp了，还需要安装这个吗？

#5

这个是单独的sql诊断工具，更详细和全面点，8080端口如果被占用了，可以修改其他端口，文档有说明。

#6

image
image2086×278 31.3 KB

诊断工具分析不了ob4.0的吗？
我看表名变了，oceanbase.gv$ob_sql_audit

#7

刚确认了下，4.0版本暂不支持。

#8

好的，谢谢了

#9

sql执行记录

*************************** 4835. row ***************************
SVR_IP: 133.197.206.92
SVR_PORT: 2882
REQUEST_ID: 3654837
SQL_EXEC_ID: 72052073
TRACE_ID: YB4285C5CE5C-0005EEB0A5998F48-0-0
SID: 3221853927
CLIENT_IP: 133.197.204.3
CLIENT_PORT: 33394
TENANT_ID: 1002
TENANT_NAME: daren
EFFECTIVE_TENANT_ID: 1002
USER_ID: 200001
USER_NAME: root
USER_GROUP: 0
USER_CLIENT_IP: 172.17.0.6
DB_ID: 500008
DB_NAME: wcn
SQL_ID: B4B998A799045CAF3499B18A961A6F88
QUERY_SQL: insert into widenetwork.pppoe_User (facility, isdx, node_number, oltip, oltjx, oltpon, phone, qyId, qzdsphone, serialNumber, username, whry, whwg, whwgId, xq, zjdz, id) values (?)
PLAN_ID: 14330
AFFECTED_ROWS: 1
RETURN_ROWS: 0
PARTITION_CNT: 1
RET_CODE: 0
QC_ID: 0
DFO_ID: 0
SQC_ID: 0
WORKER_ID: 0
EVENT:
P1TEXT:
P1: 0
P2TEXT:
P2: 0
P3TEXT:
P3: 0
LEVEL: 0
WAIT_CLASS_ID: 100
WAIT_CLASS#: 0
WAIT_CLASS: OTHER
STATE: MAX_WAIT TIME ZERO
WAIT_TIME_MICRO: 0
TOTAL_WAIT_TIME_MICRO: 0
TOTAL_WAITS: 0
RPC_COUNT: 0
PLAN_TYPE: 1
IS_INNER_SQL: 0
IS_EXECUTOR_RPC: 0
IS_HIT_PLAN: 1
REQUEST_TIME: 1670381259427561
ELAPSED_TIME: 195
NET_TIME: 0
NET_WAIT_TIME: 2
QUEUE_TIME: 35
DECODE_TIME: 0
GET_PLAN_TIME: 28
EXECUTE_TIME: 118
APPLICATION_WAIT_TIME: 0
CONCURRENCY_WAIT_TIME: 0
USER_IO_WAIT_TIME: 0
SCHEDULE_TIME: 0
ROW_CACHE_HIT: 0
BLOOM_FILTER_CACHE_HIT: 0
BLOCK_CACHE_HIT: 0
DISK_READS: 0
RETRY_CNT: 0
TABLE_SCAN: 0
CONSISTENCY_LEVEL: 3
MEMSTORE_READ_ROW_COUNT: 0
SSSTORE_READ_ROW_COUNT: 0
DATA_BLOCK_READ_CNT: 0
DATA_BLOCK_CACHE_HIT: 0
INDEX_BLOCK_READ_CNT: 0
INDEX_BLOCK_CACHE_HIT: 0
BLOCKSCAN_BLOCK_CNT: 0
BLOCKSCAN_ROW_CNT: 0
PUSHDOWN_STORAGE_FILTER_ROW_CNT: 0
REQUEST_MEMORY_USED: 19680
EXPECTED_WORKER_COUNT: 0
USED_WORKER_COUNT: 0
SCHED_INFO: NULL
FUSE_ROW_CACHE_HIT: 0
PS_CLIENT_STMT_ID: -1
PS_INNER_STMT_ID: -1
TX_ID: 4514773
SNAPSHOT_VERSION: 0
REQUEST_TYPE: 2
IS_BATCHED_MULTI_STMT: 0
OB_TRACE_INFO: NULL
PLAN_HASH: 3290318591324336132
LOCK_FOR_READ_TIME: 0
PARAMS_VALUE:

只找到类似id的记录，trace-id:YB4285C5CE5C-0005EEB08DB828F3-0-0
observer.log.zip (1.3 MB)