Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Get the history info in Yarn


+
Pedro Sá da Costa 2013-06-13, 05:22
+
Devaraj K 2013-06-13, 05:41
+
Pedro Sá da Costa 2013-06-13, 06:07
Copy link to this message
-
Re: Get the history info in Yarn
and how can I get these values using the job id in java?

On 13 June 2013 08:15, Devaraj k <[EMAIL PROTECTED]> wrote:

>  As per my understanding as of now start and end times are not available
> through shell command. You can use the  JobClient API to get the same.****
>
> ** **
>
> Thanks&Regards****
>
>    Devaraj****
>
> ** **
>
> *From:* Pedro Sá da Costa [mailto:[EMAIL PROTECTED]]
> *Sent:* 13 June 2013 11:37
> *To:* mapreduce-user; Devaraj k
> *Subject:* Re: Get the history info in Yarn****
>
> ** **
>
> But this command doesn't tell me the job duration, or job start time and
> end time. How can I get this info?****
>
> ** **
>
> On 13 June 2013 07:41, Devaraj K <[EMAIL PROTECTED]> wrote:****
>
> Hi,****
>
>  ****
>
>     You can get all the details for Job using this mapred command****
>
>  ****
>
> >mapred job –status <Job-ID>****
>
>  ****
>
> For this you need to have Job History Server Running and the same job
> history server address configured in the client side.****
>
>  ****
>
>  ****
>
> Thanks & Regards****
>
>     Devaraj K****
>
>  ****
>
> *From:* Pedro Sá da Costa [mailto:[EMAIL PROTECTED]]
> *Sent:* Thursday, June 13, 2013 10:52 AM
> *To:* mapreduce-user
> *Subject:* Get the history info in Yarn****
>
>  ****
>
> I tried the command "mapred job list all" to get the history of the jobs
> completed, but the log  doesn't have the time where a jobs started, end,
> the number of maps and reduce, and the size of data read and written. Can I
> get this info by a shell command?****
>
> I am using Yarn.
> ****
>
>
> --
> Best regards,****
>
>
>
>
> --
> Best regards,****
>

--
Best regards,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB