Problem in Matlab + Hadoop Intergration

Good Morning Sir, I tried to integrate matlab with hadoop and try to execute a simple program.But permission denied error is reported as shown in the attached fig.Could any one please help me to solve this issue.

Answer 1

[Kojiro Saito]

The error log says, when MATLAB submitted a job to YARN, /tmp/hadoop-yarn/staging/root/.staging directory in HDFS was used for a staging directory, but you don't have a permission of execution of the directory. Because you're using root user, but the permission of the HDFS's staging directory is nitw_viper_user:supergroup:drwx------. It means only nitw_viper_user user can Read/Write/Execute, and local root user cannot access to the directory.

Simply, changing the permission of staging directory in HDFS would solve this issue.

hadoop fs -chmod -R 777 /tmp/hadoop-yarn

[Jyothi Alugolu]

Sir, If i execute the above command it is showing the error as no such file or directory as shown in the attached figure.

[Kojiro Saito]

The directory will be deleted after YARN job is finished or failed, so how about make directory beforehand?

hadoop fs -mkdir -p /tmp/hadoop-yarn
hadoop fs -chmod -R 777 /tmp/hadoop-yarn

then, do your MapReduce scripts.

[Jyothi Alugolu]

tq..problem was solved...actually i tried your second comment without seeing your answer...anyway thanks for your response...

[lov kumar]

Jyothi Alugolu :

Can you please help me to fix this error:

Error using mapreduce (line 124)

The HADOOP job failed to submit. It is possible that there is some issue with the HADOOP configuration.