In MRv2 or Yarn is it possible to provide a complete path to a file instead of a directory to a mapreduce job?
Usually we provide a list of directory paths by using FileInputFormat.addInputPath. Can we provide a path which is a full path to an actually file? I have tried it but getting unexpected permission errors.
That is what I thought so too but when I give the parent directory as the input path of that same file, it works. Perhaps I am messing something up. I am suing cloudera 4.6 btw.
Meanwhile I have noticed that I can read files directly by using MultileInputs and that works fine.
Regards, Shahab On Thu, Jul 17, 2014 at 11:23 AM, Bertrand Dechoux <[EMAIL PROTECTED]> wrote:
NEW: Monitor These Apps!
Apache Lucene, Apache Solr and all other Apache Software Foundation project and their respective logos are trademarks of the Apache Software Foundation.
Elasticsearch, Kibana, Logstash, and Beats are trademarks of Elasticsearch BV, registered in the U.S. and in other countries. This site and Sematext Group is in no way affiliated with Elasticsearch BV.
Service operated by Sematext