Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - RE: Cluster lost IP addresses


+
John Meza 2013-03-24, 02:48
+
John Meza 2013-03-22, 21:50
+
Balaji Narayanan 2013-03-23, 02:14
+
Azuryy Yu 2013-03-23, 03:31
+
Harsh J 2013-03-23, 05:12
+
Chris Embree 2013-03-23, 05:22
Copy link to this message
-
Re: Cluster lost IP addresses
Harsh J 2013-03-23, 05:42
Hi Chris,

Where exactly are you seeing issues with change of NN/DN IPs? I've
never encountered trouble on IP changes (I keep moving across networks
everyday and the HDFS plus MR I run both stand tall without requiring
a restart). We do not store (generally) nor rely on IP addresses. An
exclusion may apply to files under construction I think, but a
properly shutdown cluster pre-move would not have that and such files
wouldn't matter too much in such a scenario anyway.

Obviously, a hostname change could cause issues.

FWIW, you can easily take any person's fsimage from across the world
and start your NN on top of that and add in new DNs with the block
data under them and setup the HDFS cluster. This is rather painless
and well-built and goes to show that its not really IP dependent in
any way. Please do elaborate.

On Sat, Mar 23, 2013 at 10:52 AM, Chris Embree <[EMAIL PROTECTED]> wrote:
> Hey John,
>
> Make sure your /etc/hosts ( or DNS) is up to date and  any topology scripts
> are updated.  Unfortunately, NN is pretty dumb about IP's vs. Hostnames.
>
> BTW, NN devs.  Seriously?  You rely on IP addr instead of hostname?  Someone
> should probably be shot or at least be responsible for fixing this
> abomination. Sad that this code was released GA.
>
> Sorry folks.  HDFS/Mapred is really cool tech, I'm just jaded about this
> kind of silliness.
>
> In my Not So Humble Opinion.
> Chris
>
>
> On Sat, Mar 23, 2013 at 1:12 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>>
>> NameNode does not persist block locations; so this is still
>> recoverable if the configs are changed to use the new set of hostnames
>> to bind to/look up.
>>
>> On Sat, Mar 23, 2013 at 9:01 AM, Azuryy Yu <[EMAIL PROTECTED]> wrote:
>> > it has issues, namenode save blockid->nodes, using ip addr if your
>> > slaves
>> > config file using ip addr instead of hostname.
>> >
>> > On Mar 23, 2013 10:14 AM, "Balaji Narayanan (பாலாஜி நாராயணன்)"
>> > <[EMAIL PROTECTED]> wrote:
>> >>
>> >> Assuming you are using hostnAmes and not ip address in your config
>> >> files
>> >> What happens when you start the cluster? If you are using IP address in
>> >> your
>> >> configs just update them and start. It should work with no issues.
>> >>
>> >> On Friday, March 22, 2013, John Meza wrote:
>> >>>
>> >>> I have a 18 node cluster that had to be physically moved.
>> >>> Unfortunately all the ip addresses were lost (recreated).
>> >>>
>> >>> This must have happened to someone before.
>> >>> Nothing else on the machines has been changed. Most importantly the
>> >>> data
>> >>> in HDFS is still sitting there.
>> >>>
>> >>> Is there a way to recover this cluster to a useable state?
>> >>> thanks
>> >>> John
>> >>
>> >>
>> >>
>> >> --
>> >> http://balajin.net/blog
>> >> http://flic.kr/balajijegan
>>
>>
>>
>> --
>> Harsh J
>
>

--
Harsh J