Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # dev >> Review Request 15650: ACCUMULO-1794 adds hdfs failover to continuous integration test.


+
Sean Busbey 2013-11-18, 17:13
+
Josh Elser 2013-11-18, 18:33
+
Sean Busbey 2013-11-18, 18:51
+
Josh Elser 2013-11-22, 19:47
+
Sean Busbey 2013-11-21, 21:10
+
Sean Busbey 2013-12-05, 21:55
+
Sean Busbey 2013-11-18, 17:31
Copy link to this message
-
Re: Review Request 15650: ACCUMULO-1794 adds hdfs failover to continuous integration test.
On Mon, Nov 18, 2013 at 12:31 PM, Sean Busbey <busbey+[EMAIL PROTECTED]>wrote:

> Hey Folks,
>
> I have a proposed agitator script for flexing Hadoop 2's HDFS HA failover.
> I'm looking for other features of Hadoop 2 that would be relevant for
> ACCUMULO-1794.
>
> One related question I'd like to get a read on: the JobTracker HA in CDH4.
> As a quick recap,CDH4.2.0+ includes HA support for MRv1, including
> automatic failover between jobtrackers. When a failover occurs, jobs have
> to restart.
>
> I have a similar agitator script to the one for HDFS HA that works to fail
> over the job tracker. JobTracker HA doesn't exist in any Apache Hadoop
> release, so I'm not sure if I should include it in the general test suite
> as it would only be applicable to clusters running CDH4+ (unless some other
> distro adds an equivalent administrative command).
>
> Thoughts?
>

I do not see a problem w/ adding this to out test scripts as long as their
is adequate documentation making it clear its for CDH4.  The continuous
ingest test do use map reduce.   Would it be better to put this script in
CDH4?
>
>
> On Mon, Nov 18, 2013 at 11:13 AM, Sean Busbey <[EMAIL PROTECTED]> wrote:
>
> >
> > -----------------------------------------------------------
> > This is an automatically generated e-mail. To reply, visit:
> > https://reviews.apache.org/r/15650/
> > -----------------------------------------------------------
> >
> > Review request for accumulo and Alex Moundalexis.
> >
> >
> > Bugs: ACCUMULO-1794
> >     https://issues.apache.org/jira/browse/ACCUMULO-1794
> >
> >
> > Repository: accumulo
> >
> >
> > Description
> > -------
> >
> > ACCUMULO-1794 adds hdfs failover to continuous integration test.
> >
> >
> > Diffs
> > -----
> >
> >   test/system/continuous/continuous-env.sh.example
> > 830ae86b5bf2398a840b853423755f6dd65f2dc0
> >   test/system/continuous/hdfs-agitator.pl PRE-CREATION
> >   test/system/continuous/start-agitator.sh
> > 52e5a4e82a4564fa624a71f73ad29fa20ba23246
> >   test/system/continuous/stop-agitator.sh
> > b853a55b12f8402606af52e0748ca50daf95ed7f
> >
> > Diff: https://reviews.apache.org/r/15650/diff/
> >
> >
> > Testing
> > -------
> >
> > Ran the hdfs agitator on a CDH4 cluster configured for HA. it
> successfully
> > caused the active namenode to failover as it went.
> >
> >
> > Thanks,
> >
> > Sean Busbey
> >
> >
>
>
> --
> Sean
>
+
Sean Busbey 2013-11-20, 19:38
+
Sean Busbey 2013-11-18, 17:21
+
keith@... 2013-11-20, 16:16
+
Sean Busbey 2013-11-20, 16:22
+
Keith Turner 2013-11-20, 16:41
+
keith@... 2013-11-20, 16:57
+
Sean Busbey 2013-11-20, 17:33
+
keith@... 2013-11-20, 17:56
+
Sean Busbey 2013-12-05, 21:49
+
Alex Moundalexis 2013-12-06, 16:54
+
Alex Moundalexis 2013-12-06, 16:55