Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Avoid creation of _SUCCESS folder in reducer output folder


Copy link to this message
-
Re: Avoid creation of _SUCCESS folder in reducer output folder
mapreduce.fileoutputcommitter.marksuccessfuljobs=false;
MAPREDUCE-947, i guess..

~Aniket

On Thu, Oct 4, 2012 at 11:06 PM, Balaraman, Anand <
[EMAIL PROTECTED]> wrote:

>  Hi****
>
> ** **
>
> While using Map reduce programs, the output folder where reducer writes
> out the result contains 2 auto-generated folders: *_SUCCESS* and *_logs*.*
> ***
>
> To avoid generation of *_log* folder, I can set the configuration
> parameter “*hadoop.job.history.user.location*” with value as “*none*”.****
>
> But, I don’t know how to avoid the creation of *_SUCCESS* folder. Can
> anyone please help.****
>
> ** **
>
> *Note*: For now, as a work around, I am using FileSystem commands at the
> end of job to delete the folder manually.****
>
> ** **
>
> Anand B****
>  Confidential: This electronic message and all contents contain
> information from Syntel, Inc. which may be privileged, confidential or
> otherwise protected from disclosure. The information is intended to be for
> the addressee only. If you are not the addressee, any disclosure, copy,
> distribution or use of the contents of this message is prohibited. If you
> have received this electronic message in error, please notify the sender
> immediately and destroy the original message and all copies.
>

--
"...:::Aniket:::... Quetzalco@tl"
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB