Storing large matrix to file

I need to store several 2000x1,000,000 matrices to a file. Is this feasible? I used the method outlined here and nearly crashed my computer (I can tell it's not an efficient way... but thought I'd try).
Do I need to partition the data and then rebuild it?
Thanks

5 commentaires

KSSV
KSSV le 17 Avr 2018
First are you able to create such a big matrix? You are creating matrix at once? Or by parts?
Joppy
Joppy le 17 Avr 2018
It's a dynamical system simulation. 2000 initial conditions, 1M iterations. I can probably do with 500K iterations but would like to do more if possible.
The matrix is generated 1 row at a time.
Joppy
Joppy le 17 Avr 2018
Ok so I should be able to average along each column without loss of information... Still curious if it's feasible to do.
KSSV
KSSV le 17 Avr 2018
Then you can write matrix row by row.....to a text file..or to a netcdf file. No worries...
Joppy
Joppy le 17 Avr 2018
Turns out I couldn't average the data. I ended up using the save function, it's quite fast. I don't understand why we bother with fprintf.

Connectez-vous pour commenter.

Réponses (0)

Catégories

Question posée :

le 17 Avr 2018

Commenté :

le 17 Avr 2018

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by