how shall I read/write/add-write big data in MatLab?

I set big data in variable X and Now I want to save it on my hard disk;
I use "save output X", and get warning: "out of memory";
I use "xlswrite('output.xlsx',X)", and get warnning: it is too big for this format;
Now how shall I write this big data and especially what if I want to add other data for other code into the "output" and how shall I read it out if it is too big?

Réponses (2)

Walter Roberson
Walter Roberson le 1 Jan 2017

1 vote

If it is a numeric array, you could fwrite() it as a binary file.
For non-numeric items sometimes using memory mapping is appropriate.
You might be able to use the matFile interface to save part of it at a time.

2 commentaires

See memmapfile().
thanks a lot! I now try to use "dlmwrite/dlmread' and it is ok; thanks everyone.

Connectez-vous pour commenter.

Image Analyst
Image Analyst le 1 Jan 2017

1 vote

One option is to split the workbook up into smaller workbooks, if there is anyway that makes sense, otherwise just arbitrarily at rows like 'firstHalf.xlsx' and 'secondHalf.xlsx'.

Catégories

En savoir plus sur Large Files and Big Data dans Centre d'aide et File Exchange

Tags

Question posée :

le 1 Jan 2017

Commenté :

le 2 Jan 2017

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by