Using datastore and tall arrays for files that are too big for memory

1 vue (au cours des 30 derniers jours)
Aaron Smith
Aaron Smith le 3 Juil 2017
Commenté : Jeremy Hughes le 7 Juil 2017
I have been looking at using datastore on files that have proven too much for matlab's memory. I was using fopen and textscan, fgetl, sscanf and dlmread. A recurring problem with each different command is memory. My data is saved in two different formats, an extremely large file containing 200 individual matrices and as the individual 200 matrices. When looking at creating tall arrays to fix the memory issues, I came across a problem. Which datastore command should I use? The individual files could be added to datastore using fileDatastore or the bulk file could use tabularTextDatastore but no matter which method i use, i get the same error:
Undefined function 'datastore' for input arguments of type 'char'.
I have tried multiple different methods of specifying the file\folder. I have used uigetfile and uigetdir to specify the file and I have also explicitly stated the file, either by setting the current folder and naming the file or with the 'C:\Users\c13459232\Documents....' method. They all return the same error. Is there something I am missing here?
  3 commentaires
Aaron Smith
Aaron Smith le 4 Juil 2017
Modifié(e) : Aaron Smith le 4 Juil 2017
2012a. This means that tall arrays and datastore are not available to me, yes_
Jeremy Hughes
Jeremy Hughes le 7 Juil 2017
Yes, tall arrays are available in R2016b.

Connectez-vous pour commenter.

Réponses (0)

Catégories

En savoir plus sur Large Files and Big Data dans Help Center et File Exchange

Produits

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by