Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - Re: no _SUCCESS file in MR output directory.

Copy link to this message
Re: no _SUCCESS file in MR output directory.
Harsh J 2013-05-05, 17:56
I can think of a few, most obvious ones:

1. Job didn't succeed and/or the file was deleted (*shields self*)
2. Job overrode the default FileOutputCommitter with something that
doesn't do success marking.
3. Job specifically asked to not create such files, via config
mapreduce.fileoutputcommitter.marksuccessfuljobs or so, set to false.

On Sun, May 5, 2013 at 9:54 PM, Rahul Bhattacharjee
> Hi,
> A few days back , I was going through a MR job's output , but there wasn't
> any _SUCCESS file in the output directory.
> I was wondering what all reasons for this  (no _SUCCESS file)?
> Thanks,
> Rahul

Harsh J
Harsh J 2013-05-07, 07:44
Rahul Bhattacharjee 2013-05-07, 08:49