导入官方csv数据问题

seekdb
#1

mysql> SET GLOBAL ob_trx_timeout=1000000000,GLOBAL ob_query_timeout=1000000000;
Query OK, 0 rows affected (0.01 sec)

mysql> LOAD DATA FROM FILES( LOCATION = ‘/opt/’,FORMAT = (TYPE = ‘csv’,FIELD_DELIMITER = ‘,’),PATTERN = ‘sports_data_whole.csv’) INTO TABLE sport_data_whole;
ERROR 4012 (HY000): Timeout
mysql>

使用客户端工具导入超级慢，用命令在服务器上也没办法导入。

#3

GLOBAL变量需要打开新链接才生效 重新执行下导入试试

#4

2核8G，服务器，导入这里的数据示例数据：体验全文索引 | seekdb

半小时都导不完，是否还需要优化些什么？

#5

一共10w行数据不可能这么慢，加个并行试试PARALLEL(8)

#6

新问题又来了，导着30分钟左右后，自己挂了。。。。。
mysql> LOAD DATA /*+ PARALLEL(8) */ INFILE ‘/opt/sports_data_whole.csv’ INTO TABLE sport_data_whole FIELDS TERMINATED BY ‘,’ LINES TERMINATED BY ‘\n’;
ERROR 2013 (HY000): Lost connection to MySQL server during query
No connection. Trying to reconnect…
ERROR 2003 (HY000): Can’t connect to MySQL server on ‘127.0.0.1:2881’ (111)
ERROR:
Can’t connect to the server

#7

使用旁路导入试一试
使用 LoadData 旁路导入语句进行数据导入。

LOAD DATA /*+ PARALLEL(10) APPEND */ INFILE ‘/opt/sports_data_whole.csv’ INTO TABLE sport_data_whole FIELDS TERMINATED BY ‘,’ LINES TERMINATED BY ‘\n’;

#8

我估计是我服务器不行，2核太少了，
mysql>
mysql> LOAD DATA /*+ PARALLEL(10) APPEND */ INFILE ‘/opt/sports_data_whole.csv’ INTO TABLE sport_data_whole FIELDS TERMINATED BY ‘,’ LINES TERMINATED BY ‘\n’;
ERROR 2013 (HY000): Lost connection to MySQL server during query
No connection. Trying to reconnect…
ERROR 2003 (HY000): Can’t connect to MySQL server on ‘127.0.0.1:2881’ (111)
ERROR:
Can’t connect to the server

#9

试一下导入部署数据试试。就2c不建议开并行了

#10

谢谢分享