Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # dev >> Clarifications on MAPREDUCE-5183


+
maisnam ns 2013-05-21, 08:02
+
Sandy Ryza 2013-05-21, 17:50
+
maisnam ns 2013-05-21, 17:55
+
Sandy Ryza 2013-05-21, 17:57
+
maisnam ns 2013-05-21, 18:06
Copy link to this message
-
Re: Clarifications on MAPREDUCE-5183
BTW, there is a handy helper function in Hadoop Common that can help you
with this: org.apache.hadoop.util.StringUtils.formatPercent.

Chris Nauroth
Hortonworks
http://hortonworks.com/

On Tue, May 21, 2013 at 11:06 AM, maisnam ns <[EMAIL PROTECTED]> wrote:

> Hi Sandy,
>
> Sure, I would do exactly what you are suggesting.
>
> Regards
> Niranjan Singh
>
>
> On Tue, May 21, 2013 at 11:27 PM, Sandy Ryza <[EMAIL PROTECTED]
> >wrote:
>
> > If you're planning to fix it, it would probably look prettiest to keep
> the
> > percentage sign and have the numbers between 0 and 100.
> >
> > -Sandy
> >
> >
> > On Tue, May 21, 2013 at 10:55 AM, maisnam ns <[EMAIL PROTECTED]>
> wrote:
> >
> > > Thanks Sandy Ryza
> > >
> > >
> > >
> > >
> > > On Tue, May 21, 2013 at 11:20 PM, Sandy Ryza <[EMAIL PROTECTED]
> > > >wrote:
> > >
> > > > Hi Niranjan,
> > > >
> > > > Your understanding is correct.
> > > >
> > > > -Sandy
> > > >
> > > >
> > > > On Tue, May 21, 2013 at 1:02 AM, maisnam ns <[EMAIL PROTECTED]>
> > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I was looking into this issue but would be happy if someone could
> > > clarify
> > > > > some of my doubts.
> > > > >
> > > > > Is the issue related to the given below snapshot of log:
> > > > >
> > > > > org.apache.hadoop.mapred.TaskTracker: Task
> > > > > attempt_201305211246_0001_r_000001_0 is in commit-pending, task
> > > > > state:COMMIT_PENDING 2013-05-21 12:48:51,058 INFO
> > > > > org.apache.hadoop.mapred.TaskTracker:
> > > > > attempt_201305211246_0001_r_000001_0 0.0% reduce > copy >
> 2013-05-21
> > > > > 12:48:51,769 DEBUG org.apache.hadoop.mapred.TaskTracker:
> > > > > Got heartbeatResponse from JobTracker with responseId: 27 and 2
> > > > > actions 2013-05-21 12:48:51,769 INFO
> > > > org.apache.hadoop.mapred.TaskTracker:
> > > > >  Received commit task action for
> > > > >  attempt_201305211246_0001_r_000000_0 2013-05-21 12:48:51,769
> > > > >  INFO org.apache.hadoop.mapred.TaskTracker:
> > > > >  Received commit task action for
> > > > >  attempt_201305211246_0001_r_000001_0 2013-05-21 12:48:53,695
> > > > >  INFO org.apache.hadoop.mapred.TaskTracker:
> > > > >   attempt_201305211246_0001_r_000001_0 1.0% reduce >
> > > > >   reduce 2013-05-21 12:48:53,777 INFO
> > > > >
> > > > > The issue says 'TaskTracker#reportProgress logging of 0.0-1.0
> > progress
> > > > > is followed by percent sign'
> > > > >
> > > > >
> > > > > 1.attempt_201305211246_0001_r_000001_0 0.0% reduce
> > > > > 2.attempt_201305211246_0001_r_000001_0 1.0% reduce
> > > > >
> > > > > If my understanding is correct the percent sign at the end of 0.0
> and
> > > 1.0
> > > > >
> > > > > should be removed.
> > > > >
> > > > > Regards
> > > > >
> > > > > Niranjan Singh
> > > > >
> > > >
> > >
> >
>
+
maisnam ns 2013-05-21, 22:02
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB