Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Job history logging


Copy link to this message
-
Re: Job history logging
I guess the reason is that it assumes it can't write history files
after that point, and skips the rest of the work?

On Sat, Sep 15, 2012 at 3:07 AM, Prashant Kommireddi
<[EMAIL PROTECTED]> wrote:
> Hi All,
>
> I have a question about job history logging. Seems like history logging is
> disabled if file creation fails, is there a reason this is done?
> The following snippet is from JobHistory.JobInfo.logSubmitted(....)  -
> Hadoop 0.20.2
>
>
>           // Log the history meta info
>           JobHistory.MetaInfoManager.logMetaInfo(writers);
>
>           //add to writer as well
>           JobHistory.log(writers, RecordTypes.Job,
>                          new Keys[]{Keys.JOBID, Keys.JOBNAME, Keys.USER,
> Keys.SUBMIT_TIME, Keys.JOBCONF },
>                          new String[]{jobId.toString(), jobName, user,
>                                       String.valueOf(submitTime) ,
> jobConfPath}
>                         );
>
>         }catch(IOException e){
>           LOG.error("Failed creating job history log file, disabling
> history", e);
>           *disableHistory = true; *
>         }
>       }
>
>
> Thanks,

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB