All

We have a master in one region and we are trying to start a slave datanode in another region. When executing the scripts it looks to login to the remote host, but
never starts the datanode. When executing hbase tho it does work. Is there a timeout or something with hadoop?

Try checking the logs in the logs folder for the datanode.It might give
some lead.
Maybe there is a mismatch between the namespace iDs in the system and user
itself while starting the datanode.

On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]>wrote:

> All
>
> We have a master in one region and we are trying to start a slave datanode
> in another region. When executing the scripts it looks to login to the
> remote host, but
> never starts the datanode. When executing hbase tho it does work. Is there
> a timeout or something with hadoop?

Strange thing is the datanode in the remote location has a log zero bytes. So nothing there.
Its strange it is like the master does and ssh, login, and then attempts to start it but nothing. Maybe there is a timeout?
On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:

> Try checking the logs in the logs folder for the datanode.It might give
> some lead.
> Maybe there is a mismatch between the namespace iDs in the system and user
> itself while starting the datanode.
>
> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]>wrote:
>
>> All
>>
>> We have a master in one region and we are trying to start a slave datanode
>> in another region. When executing the scripts it looks to login to the
>> remote host, but
>> never starts the datanode. When executing hbase tho it does work. Is there
>> a timeout or something with hadoop?

Probably a timeout.
Really, not a good idea to do this in the first place...

Sent from my iPhone

On Mar 30, 2012, at 12:35 PM, "Ben Cuthbert" <[EMAIL PROTECTED]> wrote:

> Strange thing is the datanode in the remote location has a log zero bytes. So nothing there.
> Its strange it is like the master does and ssh, login, and then attempts to start it but nothing. Maybe there is a timeout?
>
>
> On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:
>
>> Try checking the logs in the logs folder for the datanode.It might give
>> some lead.
>> Maybe there is a mismatch between the namespace iDs in the system and user
>> itself while starting the datanode.
>>
>> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]>wrote:
>>
>>> All
>>>
>>> We have a master in one region and we are trying to start a slave datanode
>>> in another region. When executing the scripts it looks to login to the
>>> remote host, but
>>> never starts the datanode. When executing hbase tho it does work. Is there
>>> a timeout or something with hadoop?
>

Agree with the not a great idea. We are toying with various configurations. We want to run a distributed application server in multiple regions. We are looking
at having multiple masters and using replication, but we wanted to see what the performance would be like doing single master multiple datanodes.
On 30 Mar 2012, at 18:52, Michael Segel wrote:

> Probably a timeout.
> Really, not a good idea to do this in the first place...
>
> Sent from my iPhone
>
> On Mar 30, 2012, at 12:35 PM, "Ben Cuthbert" <[EMAIL PROTECTED]> wrote:
>
>> Strange thing is the datanode in the remote location has a log zero bytes. So nothing there.
>> Its strange it is like the master does and ssh, login, and then attempts to start it but nothing. Maybe there is a timeout?
>>
>>
>> On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:
>>
>>> Try checking the logs in the logs folder for the datanode.It might give
>>> some lead.
>>> Maybe there is a mismatch between the namespace iDs in the system and user
>>> itself while starting the datanode.
>>>
>>> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]>wrote:
>>>
>>>> All
>>>>
>>>> We have a master in one region and we are trying to start a slave datanode
>>>> in another region. When executing the scripts it looks to login to the
>>>> remote host, but
>>>> never starts the datanode. When executing hbase tho it does work. Is there
>>>> a timeout or something with hadoop?
>>

Does the namenode log contain any entries for the datanode you are trying to
start?

-----Original Message-----
From: Ben Cuthbert [mailto:[EMAIL PROTECTED]]
Sent: Friday, March 30, 2012 10:35 AM
To: [EMAIL PROTECTED]
Subject: Re: start hadoop slave over WAN

Strange thing is the datanode in the remote location has a log zero bytes.
So nothing there.
Its strange it is like the master does and ssh, login, and then attempts to
start it but nothing. Maybe there is a timeout?
On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:

> Try checking the logs in the logs folder for the datanode.It might
> give some lead.
> Maybe there is a mismatch between the namespace iDs in the system and
> user itself while starting the datanode.
>
> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert
<[EMAIL PROTECTED]>wrote:
>
>> All
>>
>> We have a master in one region and we are trying to start a slave
>> datanode in another region. When executing the scripts it looks to
>> login to the remote host, but never starts the datanode. When
>> executing hbase tho it does work. Is there a timeout or something
>> with hadoop?

no nothing. Is there extra debug one can put on the master when starting up?
On 30 Mar 2012, at 19:10, Ben Cuthbert wrote:

> Agree with the not a great idea. We are toying with various configurations. We want to run a distributed application server in multiple regions. We are looking
> at having multiple masters and using replication, but we wanted to see what the performance would be like doing single master multiple datanodes.
> On 30 Mar 2012, at 18:52, Michael Segel wrote:
>
>> Probably a timeout.
>> Really, not a good idea to do this in the first place...
>>
>> Sent from my iPhone
>>
>> On Mar 30, 2012, at 12:35 PM, "Ben Cuthbert" <[EMAIL PROTECTED]> wrote:
>>
>>> Strange thing is the datanode in the remote location has a log zero bytes. So nothing there.
>>> Its strange it is like the master does and ssh, login, and then attempts to start it but nothing. Maybe there is a timeout?
>>>
>>>
>>> On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:
>>>
>>>> Try checking the logs in the logs folder for the datanode.It might give
>>>> some lead.
>>>> Maybe there is a mismatch between the namespace iDs in the system and user
>>>> itself while starting the datanode.
>>>>
>>>> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]>wrote:
>>>>
>>>>> All
>>>>>
>>>>> We have a master in one region and we are trying to start a slave datanode
>>>>> in another region. When executing the scripts it looks to login to the
>>>>> remote host, but
>>>>> never starts the datanode. When executing hbase tho it does work. Is there
>>>>> a timeout or something with hadoop?
>>>
>

login your remote datanode and start the datanode manually to see what
happen.

start HDFS based on the WAN is not as easy as on a cluster. There are many
issues. datanode log should be the best way to shoot troubles.

Chen

On Fri, Mar 30, 2012 at 12:52 PM, Michael Segel
<[EMAIL PROTECTED]>wrote:

> Probably a timeout.
> Really, not a good idea to do this in the first place...
>
> Sent from my iPhone
>
> On Mar 30, 2012, at 12:35 PM, "Ben Cuthbert" <[EMAIL PROTECTED]>
> wrote:
>
> > Strange thing is the datanode in the remote location has a log zero
> bytes. So nothing there.
> > Its strange it is like the master does and ssh, login, and then attempts
> to start it but nothing. Maybe there is a timeout?
> >
> >
> > On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:
> >
> >> Try checking the logs in the logs folder for the datanode.It might give
> >> some lead.
> >> Maybe there is a mismatch between the namespace iDs in the system and
> user
> >> itself while starting the datanode.
> >>
> >> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert <[EMAIL PROTECTED]
> >wrote:
> >>
> >>> All
> >>>
> >>> We have a master in one region and we are trying to start a slave
> datanode
> >>> in another region. When executing the scripts it looks to login to the
> >>> remote host, but
> >>> never starts the datanode. When executing hbase tho it does work. Is
> there
> >>> a timeout or something with hadoop?
> >
>

Do you see entries in the namenode log for the other datanodes listed in the
slaves file?

-----Original Message-----
From: Ben Cuthbert [mailto:[EMAIL PROTECTED]]
Sent: Friday, March 30, 2012 3:28 PM
To: [EMAIL PROTECTED]
Subject: Re: start hadoop slave over WAN

no nothing. Is there extra debug one can put on the master when starting up?
On 30 Mar 2012, at 19:10, Ben Cuthbert wrote:

> Agree with the not a great idea. We are toying with various
> configurations. We want to run a distributed application server in
multiple regions. We are looking at having multiple masters and using
replication, but we wanted to see what the performance would be like doing
single master multiple datanodes.
> On 30 Mar 2012, at 18:52, Michael Segel wrote:
>
>> Probably a timeout.
>> Really, not a good idea to do this in the first place...
>>
>> Sent from my iPhone
>>
>> On Mar 30, 2012, at 12:35 PM, "Ben Cuthbert" <[EMAIL PROTECTED]>
wrote:
>>
>>> Strange thing is the datanode in the remote location has a log zero
bytes. So nothing there.
>>> Its strange it is like the master does and ssh, login, and then attempts
to start it but nothing. Maybe there is a timeout?
>>>
>>>
>>> On 30 Mar 2012, at 18:22, kasi subrahmanyam wrote:
>>>
>>>> Try checking the logs in the logs folder for the datanode.It might
>>>> give some lead.
>>>> Maybe there is a mismatch between the namespace iDs in the system
>>>> and user itself while starting the datanode.
>>>>
>>>> On Fri, Mar 30, 2012 at 10:32 PM, Ben Cuthbert
<[EMAIL PROTECTED]>wrote:
>>>>
>>>>> All
>>>>>
>>>>> We have a master in one region and we are trying to start a slave
>>>>> datanode in another region. When executing the scripts it looks to
>>>>> login to the remote host, but never starts the datanode. When
>>>>> executing hbase tho it does work. Is there a timeout or something
>>>>> with hadoop?
>>>
>