How to handle big csv files
7 vues (au cours des 30 derniers jours)
Afficher commentaires plus anciens
I have huge .csv files comming daily and i want to know how i can handle them. For the moment, only to have an idea, i run a python script first in order to decrease the size by averaging the file. Is splitting the big file the only option i have?
P.S. one line of my file looks like:
00:00:0;0.0;0.00540500736377
0 commentaires
Réponses (1)
Walter Roberson
le 1 Sep 2018
Another approach is to fopen() the file, and textscan() using a repeat count (a number as the parameter after the format string) to control how many lines are read at a time; you would read a chunk, process it, go back to read another chunk, and so on.
0 commentaires
Voir également
Catégories
En savoir plus sur Standard File Formats dans Help Center et File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!