Read non-tabular text file using datastore or mapreduce
1 vue (au cours des 30 derniers jours)
Afficher commentaires plus anciens
How can I read non-tabular text file using datastore or mapreduce? Thanks
0 commentaires
Réponses (2)
yashwanth annapureddy
le 19 Nov 2014
Hi Darek,
As you might already know datastore is primarily meant for large tabular data sets. Non-tabular/blocked reading is something we want to look at also in the near future.
However you should be able to play with the TextscanFormats to read the data you care about just as you would using textscan for reading non-tabular data. For example, as you may already know, you can set the TextscanFormats as '%q' and read in a table with one variable name with the block of text for further processing.
I could probably help more, if you provide a sample text file?
hope this helps.
0 commentaires
Darek
le 19 Nov 2014
3 commentaires
yashwanth annapureddy
le 4 Déc 2014
By records if you mean lines in the file, datastore is probably not the right tool to count the number of records in a file. Lower or even system level functions like the ones mentioned in this thread might be useful for this kind of analysis.
Voir également
Catégories
En savoir plus sur MapReduce dans Help Center et File Exchange
Produits
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!