datastore for large structured data
2 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
xi
le 19 Déc 2018
Réponse apportée : Mark Sherstan
le 19 Déc 2018
There are Datastores for tabular text files, spreadsheet files, image files, etc. What if my data is a very large binary file, with the format: [size1 X double, size2 X double, ...], while the information of "size1, size2..., offset 1, offset 2..." is stored in a different metafile. I can write my own ReadFcn to load the data into a cell array, each cell is a nX1 double array. but it's way too large to fit the memory. I tried to use filedatastore and define my own Readfcn, but I couldn't use it to access portion of the data like the other datastores. Any suggestions?
0 commentaires
Réponse acceptée
Mark Sherstan
le 19 Déc 2018
If your file is to big to read into memory consider using the matfile function. You get to write the data straight to the file without loading it into RAM which may help solve your issues.
0 commentaires
Plus de réponses (0)
Voir également
Catégories
En savoir plus sur Datastore dans Help Center et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!