datainsert is very slow

Hi,

I have a table of 750000 rows by 7 columns. I use datainsert to insert into database. But it is very slow. If I sert 1 row, it is very quick; if it is 100000 rows, it take several minutes, but it take "forever" to insert 750000 rows.

How to speed it up?

Thanks.

Answer 1

[Nagarjuna Manchineni]

There are many ways to insert data a database using the command line. You can use datainsert, fastinsert, or insert. For best performance with large volumes of data, it is recommended to use datainsert or fastinsert.

As you are still experiencing performance issues, create a data file with every record in your dataset. Then, you can use this data file as input into the bulk insert functionality of your database to process the large dataset. Additionally, you can insert data with special characters such as double quotes with this file. Bulk insert provides performance gains by using the bulk insert utilities that are native to different database systems. For details about exporting data using bulk insert, see the following link:

https://www.mathworks.com/help/database/ug/exporting-data-using-bulk-insert.html

[JFz]

Thanks. I am cutting the data into multiple pieces, each has 100000 records. Seems like it take about 400 seconds for each piece with fastinsert.