How to import big sqlite3 table in Matlab?

Hi,

I have a big sqlite3 database (37gb) with 17 tables that i want to import into Matlab to analyse. I can import 15 of the 17 tables using the fetch command, but the 2 biggest tables give problems (19 gb and 2gb).

dbfile='D:\data\output.sqlite3' ;
 conn = sqlite(dbfile);

sqlquery = 'SELECT * From senor1';
sensor1 = fetch(conn,sqlquery);

What would be the best solution to import these sql tables? I tried these solutions but without luck:

• converting first to csv and than importing to matlab
• increasing java heap memory
• increasing windows virtual memory
• splitsqlquery, this doesn't work with sqlite3

Thanks

Answer 1

[Mathy]

Hi Michiel,

If you want to import a large SQLite database into MATLAB, you can use the sqlread command. Please refer to the documentation below to learn more about this command.

https://www.mathworks.com/help/database/ug/sqlite.sqlread.html

I hope this helps!