Community Profile

photo

Rick Amos

MathWorks

Last seen: Today |  Actif depuis 2012

Followers: 0   Following: 0

Contact

Developer at MathWorks, working on Parallel Computing Toolbox.

Statistiques

All
  • Knowledgeable Level 2
  • First Answer
  • Solver

Afficher les badges

Feeds

Afficher par

A répondu
Reading portions of several CSV files
You might want to take a look at tabularTextDatastore and/or tall arrays. These are geared up to do exactly this kind of thing:-...

plus de 4 ans il y a | 5

A répondu
tallArray sorting and plot error
Instead of converting State to a character vector, I would recommend using one of the string utilities. These are all supported ...

presque 5 ans il y a | 0

A répondu
Pass fileDatastore explicit AWS credentials
It is currently not possible to pass explicit credentials directly into fileDatastore. Datastore retrieves the credentials in th...

presque 5 ans il y a | 0

A répondu
Too many .mat files when using Write Tall Table
As you've likely guessed, vertical concatenation of 1600 arrays results in at least 1600 files from tall/write. This is the case...

environ 5 ans il y a | 0

| A accepté

A répondu
Generate a Datastore for binary data?
As of R2017b, MATLAB now allows you to write custom datastores. This will allow you to create datastores that handle large binar...

plus de 6 ans il y a | 2

A répondu
How to check Hadoop and Matlab Integrated Properly or Not ???
To look at whether MATLAB is running on the Hadoop cluster correctly, your best bet is to look at the Hadoop/Yarn Web UI. By def...

presque 7 ans il y a | 0

| A accepté

A répondu
How to create tall datastore from multiple data parts?
A datastore can be created from a collection of folders and so the easiest way to achieve this is to place each block of data in...

plus de 7 ans il y a | 0

A répondu
Datastore for custom files
For files on Hadoop, the File Datastore makes a temporary copy of the file on the local drive to be read by the ReadFcn. The Rea...

environ 8 ans il y a | 0

| A accepté

A répondu
How to solve ' All the input files must be Sequence files. Invalid file: '' '
This error message occurred because MATLAB could not find the output files generated by the Hadoop Job. For now, this error mess...

plus de 8 ans il y a | 1

| A accepté

A répondu
How to solve" The user home directory '/homes/' for the cluster either did not exist or was not writable by the HADOOP user."
The '/homes/' folder is related to the Hadoop property 'mapreduce.admin.user.home.dir'. This is used by Hadoop to set the HOME e...

plus de 8 ans il y a | 1

| A accepté

A répondu
How to make a MAT-file that can be used to create a Datastore for MapReduce?
In R2014b there is currently not a direct way of creating a MAT file datastore. However, there are several indirect ways that wi...

plus de 9 ans il y a | 2

| A accepté

A répondu
Mapreduce does not seem to use all available cores
In R2014b, there are some limitations with the minimum size of data that can be parallelized. To avoid this limitation, the inpu...

plus de 9 ans il y a | 0

| A accepté

A répondu
MCR problems with linux/hadoop
This behavior arises because Hadoop defines the 'HOME' environment variable of task processes to be '/homes' by default. MATLAB ...

plus de 9 ans il y a | 0