Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # dev - Re: [VOTE] Release hadoop-2.0.3-alpha


Copy link to this message
-
Re: [VOTE] Release hadoop-2.0.3-alpha
lohit 2013-02-09, 01:07
+1
Deployed on more than 100 nodes.
Ran 30TB teragen/terasort. Will run few more over the weekend to test
scheduler.
Things looks stable. I do see few failures, but those I believe are
hardware problems.

Thanks,
@lohitvijayarenu

2013/2/8 Konstantin Boudnik <[EMAIL PROTECTED]>

> The issue with the configuration is raised (and adressed) in
>   https://issues.apache.org/jira/browse/BIGTOP-841
>
> Cos
>
> On Fri, Feb 08, 2013 at 04:25PM, Aaron T. Myers wrote:
> > +1 (binding)
> >
> > I downloaded the src tar ball, built it with the native bits enabled,
> > started up a little cluster, and ran some sample jobs. Things worked as
> > expected. I also verified the signatures on the source artifact.
> >
> > I did bump into one little issue, but I don't think it should be
> considered
> > a blocker. When I first tried to start up the RM, it failed to start with
> > this error:
> >
> > 13/02/08 16:00:31 FATAL resourcemanager.ResourceManager: Error starting
> > ResourceManager
> > java.lang.IllegalStateException: Queue configuration missing child queue
> > names for root
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.parseQueue(CapacityScheduler.java:328)
> >  at
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.initializeQueues(CapacityScheduler.java:255)
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler.reinitialize(CapacityScheduler.java:220)
> >  at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.init(ResourceManager.java:226)
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.main(ResourceManager.java:710)
> >
> > And then this on shutdown:
> >
> > 13/02/08 16:00:31 INFO service.CompositeService: Error stopping
> > ResourceManager
> > java.lang.NullPointerException
> > at
> >
> org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.stop(ResourceManager.java:590)
> >  at
> >
> org.apache.hadoop.yarn.service.CompositeService$CompositeServiceShutdownHook.run(CompositeService.java:122)
> > at
> >
> org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
> >
> > Presumably this is because I don't have the CapacityScheduler queues
> > configured at all, and the default scheduler is now the
> CapacityScheduler.
> > To work around this for my testing, I switched to the FairScheduler and
> the
> > RM came up just fine.
> >
> >
> > --
> > Aaron T. Myers
> > Software Engineer, Cloudera
> >
> >
> > On Wed, Feb 6, 2013 at 7:59 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> >
> > > Folks,
> > >
> > > I've created a release candidate (rc0) for hadoop-2.0.3-alpha that I
> would
> > > like to release.
> > >
> > > This release contains several major enhancements such as QJM for HDFS
> HA,
> > > multi-resource scheduling for YARN, YARN ResourceManager restart etc.
> > > Also YARN has achieved significant stability at scale (more details
> from
> > > Y! folks here: http://s.apache.org/VYO).
> > >
> > > The RC is available at:
> > > http://people.apache.org/~acmurthy/hadoop-2.0.3-alpha-rc0/
> > > The RC tag in svn is here:
> > >
> http://svn.apache.org/viewvc/hadoop/common/tags/release-2.0.3-alpha-rc0/
> > >
> > > The maven artifacts are available via repository.apache.org.
> > >
> > > Please try the release and vote; the vote will run for the usual 7
> days.
> > >
> > > thanks,
> > > Arun
> > >
> > >
> > >
> > > --
> > > Arun C. Murthy
> > > Hortonworks Inc.
> > > http://hortonworks.com/
> > >
> > >
> > >
>

--
Have a Nice Day!
Lohit