|
|
-
How can I list all jobs history?
Pedro Costa 2012-02-28, 13:37
Hi,
In MapReduce the command bin/hadoop -job history <PATH_HISTORY> only list the first job. How can I list the history of all jobs?
-- Best regards,
-
Re: How can I list all jobs history?
Jie Li 2012-02-28, 15:40
Try "hadoop job -list" :)
Jie
On Tue, Feb 28, 2012 at 8:37 AM, Pedro Costa <[EMAIL PROTECTED]> wrote:
> Hi, > > In MapReduce the command bin/hadoop -job history <PATH_HISTORY> only list > the first job. How can I list the history of all jobs? > > -- > Best regards, > >
-
Re: How can I list all jobs history?
Pedro Costa 2012-02-28, 15:47
hadoop job -list" will only list the JobId State StartTime UserName Priority SchedulingInfo.
The job history will list in detail the time spent on each phase of the Job. The problem is that, if I've a list of job that completed, the job history only prints the details the first job, and not all jobs.
On 28 February 2012 15:40, Jie Li <[EMAIL PROTECTED]> wrote:
> Try "hadoop job -list" :) > > Jie > > > On Tue, Feb 28, 2012 at 8:37 AM, Pedro Costa <[EMAIL PROTECTED]> wrote: > >> Hi, >> >> In MapReduce the command bin/hadoop -job history <PATH_HISTORY> only list >> the first job. How can I list the history of all jobs? >> >> -- >> Best regards, >> >> > -- Best regards,
-
Re: How can I list all jobs history?
Jie Li 2012-02-28, 15:54
OK I'm not sure if there's a better way, but at least you can write a shell script to combine "job -history" and "job -list", like:
foreach `hadoop job -list` hadoop job -history $i
Jie On Tue, Feb 28, 2012 at 10:47 AM, Pedro Costa <[EMAIL PROTECTED]> wrote:
> hadoop job -list" will only list the JobId State StartTime > UserName Priority SchedulingInfo. > > The job history will list in detail the time spent on each phase of the > Job. The problem is that, if I've a list of job that completed, the job > history only prints the details the first job, and not all jobs. > > On 28 February 2012 15:40, Jie Li <[EMAIL PROTECTED]> wrote: > >> Try "hadoop job -list" :) >> >> Jie >> >> >> On Tue, Feb 28, 2012 at 8:37 AM, Pedro Costa <[EMAIL PROTECTED]> wrote: >> >>> Hi, >>> >>> In MapReduce the command bin/hadoop -job history <PATH_HISTORY> only >>> list the first job. How can I list the history of all jobs? >>> >>> -- >>> Best regards, >>> >>> >> > > > -- > Best regards, > >
|
|