Import Large Data Programmatically
You can use a
object to import large data into the MATLAB workspace. To create this object, use the
databaseDatastore function. After importing
your data into the MATLAB workspace, you can use tall arrays to analyze it.
Also, the MapReduce programming technique provides you with greater
flexibility in analyzing large data.
To split an SQL query into multiple SQL page queries and import
large data in chunks, use the
function. You can access large data by using Database Toolbox™ functions or a parallel pool (requires Parallel Computing Toolbox™).
Split SQL Query
|Initialize parallel pool using database connection|
|Split SQL query using paging|
- Working with Large Data Sets
Import and export large data sets that are stored in a database.
- Import Large Data Using DatabaseDatastore Object
DatabaseDatastoreobject for accessing collections of data stored in a relational database.
- Analyze Large Data in Database Using Tall Arrays
Find the minimum value in a large data set by using a tall table.
- Analyze Large Data in Database Using MapReduce
Write mapper and reducer functions for analyzing large data using a