MapReduce, mail # user - Re: Hello! - Hadoop: System Requirements.

Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-14, 13:24

Hello all in this list!

Thank you Harsh J for your help! I decided to post it again in order to properly identify myself in the archive list.
My name is Cristián and I am trying to learn Hadoop and to use it in near future...

I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic Edition, from IBM.
But I am facing problems now that make me wonder if there are alternative ways to learn Hadoop.

The biggest problem is that IBI demands a static IP address, and this is a tough requirement for me, since I travel a lot for business and always use IP address assigned via DHCP..
Is there a way to use Hadoop without a static IP address?

More general question: What are the system requirements for installation of Hadoop?

Thank you in advance!

Cristián Carranzal.

Re: Hello! - Hadoop: System Requirements.

Julien Muller 2012-08-14, 14:05

if your purpose is learn / dev / demo, it would be a good idea to use a VM.
You will not only be able to use a static IP, but also keep copies of
working systems, make some tests, learn how to setup a cluster with only 1
physical machine. And much more.

Julien

2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>

> Hello all in this list!
>
> Thank you Harsh J for your help! I decided to post it again in order to
> properly identify myself in the archive list.
>
>
>
>
> My name is Cristián and I am trying to learn Hadoop and to use it in near
> future...
>
> I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic
> Edition, from IBM.
> But I am facing problems now that make me wonder if there are alternative
> ways to learn Hadoop.
>
> The biggest problem is that IBI demands a static IP address, and this is a
> tough requirement for me, since I travel a lot for business and always use
> IP address assigned via DHCP..
> Is there a way to use Hadoop without a static IP address?
>
> More general question: What are the system requirements for installation
> of Hadoop?
>
> Thank you in advance!
>
> Cristián Carranzal.
>

Re: Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-14, 14:13

Julien:

Thanks for your prompt response. But...
Is there a way to use Hadoop without a static IP address with a VM?

Thanks!
From: Julien Muller
Sent: Tuesday, August 14, 2012 11:05 AM
To: [EMAIL PROTECTED]
Subject: Re: Hello! - Hadoop: System Requirements.

if your purpose is learn / dev / demo, it would be a good idea to use a VM.
You will not only be able to use a static IP, but also keep copies of working systems, make some tests, learn how to setup a cluster with only 1 physical machine. And much more.

Julien

2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>

  Hello all in this list!

  Thank you Harsh J for your help! I decided to post it again in order to properly identify myself in the archive list.
  My name is Cristián and I am trying to learn Hadoop and to use it in near future...

  I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic Edition, from IBM.
  But I am facing problems now that make me wonder if there are alternative ways to learn Hadoop.

  The biggest problem is that IBI demands a static IP address, and this is a tough requirement for me, since I travel a lot for business and always use IP address assigned via DHCP..
  Is there a way to use Hadoop without a static IP address?

  More general question: What are the system requirements for installation of Hadoop?

  Thank you in advance!

  Cristián Carranzal.

Re: Hello! - Hadoop: System Requirements.

Mohammad Tariq 2012-08-14, 14:20

If you don't want to use static IP, use the hostname everywhere in your
configuration. But you need to modify the /etc/hosts file everytime to
reflect the changes.

Regards,
Mohammad Tariq

On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <
[EMAIL PROTECTED]> wrote:

> Julien:
>
> Thanks for your prompt response. But...
> Is there a way to use Hadoop without a static IP address with a VM?
> Thanks!
>
>
> *From:* Julien Muller <[EMAIL PROTECTED]>
> *Sent:* Tuesday, August 14, 2012 11:05 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Hello! - Hadoop: System Requirements.
>
> if your purpose is learn / dev / demo, it would be a good idea to use a
> VM.
> You will not only be able to use a static IP, but also keep copies of
> working systems, make some tests, learn how to setup a cluster with only 1
> physical machine. And much more.
>
> Julien
>
> 2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>
>
>> Hello all in this list!
>>
>> Thank you Harsh J for your help! I decided to post it again in order to
>> properly identify myself in the archive list.
>>
>>
>>
>>
>> My name is Cristián and I am trying to learn Hadoop and to use it in near
>> future...
>>
>> I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic
>> Edition, from IBM.
>> But I am facing problems now that make me wonder if there are alternative
>> ways to learn Hadoop.
>>
>> The biggest problem is that IBI demands a static IP address, and this is
>> a tough requirement for me, since I travel a lot for business and always
>> use IP address assigned via DHCP..
>> Is there a way to use Hadoop without a static IP address?
>>
>> More general question: What are the system requirements for installation
>> of Hadoop?
>>
>> Thank you in advance!
>>
>> Cristián Carranzal.
>>
>
>

RE: Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-14, 18:46

Thanks again Mohammad!

Please help me to go further on your advice, since I am not good dealing with hostnames and network conf...

I am using a wired connection to the internet right now and can "ping
myself" {ping <myhostname>} and IBI/Hadoop are running fine.



But if I change to a wireless connection, I can neither ping myself anymore nor Hadoop.


Having said that: What changes in network configuration files (hostname) and in /etc/hosts are necessary in order to ping myself again, this time with a wireless DHCP IP address?

Really hope that this is not a dull question... but any help will be much appreciated.
Cristián.

From: [EMAIL PROTECTED]
Date: Tue, 14 Aug 2012 19:50:28 +0530
Subject: Re: Hello! - Hadoop: System Requirements.
To: [EMAIL PROTECTED]

If you don't want to use static IP, use the hostname everywhere in your configuration. But you need to modify the /etc/hosts file everytime to reflect the changes.Regards, Mohammad Tariq

On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <[EMAIL PROTECTED]> wrote:
Julien:

Thanks for your prompt response. But...Is there a way to use Hadoop without a static IP address
with a VM?

Thanks!

From: Julien Muller
Sent: Tuesday, August 14, 2012 11:05 AM
To: [EMAIL PROTECTED]
Subject: Re: Hello! - Hadoop: System Requirements.

if
your purpose is learn / dev / demo, it would be a good idea to use a VM.

You will not only be able to use a static IP, but also keep copies of
working systems, make some tests, learn how to setup a cluster with only 1
physical machine. And much more.

Julien

2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>



  Hello all in this list!

  Thank you Harsh J for your help! I decided to post it again in order to
  properly identify myself in the archive list.




  My name is Cristián and I am trying to learn
  Hadoop and to use it in near future...

I’ve started to learn Hadoop via
  Infosphere BigInsights (IBI), Basic Edition, from IBM.
But I am facing
  problems now that make me wonder if there are alternative ways to learn
  Hadoop.

The biggest problem is that IBI demands a static IP address,
  and this is a tough requirement for me, since I travel a lot for business and
  always use IP address assigned via DHCP..
Is there a way to use Hadoop
  without a static IP address?

More general question: What are the system
  requirements for installation of Hadoop?

Thank you in
  advance!

Cristián
Carranzal.

Re: Hello! - Hadoop: System Requirements.

Mohammad Tariq 2012-08-14, 18:56

Hello Cristian,

No question is "dull"..I also do the same thing when stuck. Now,the
reason behind your problem
is that when you switch from wired to wireless, the IP gets changed. Just
use "ifconfig" command to
get the IP and paste it in your hosts file along with your hostname. BTW,
are you using Hadoop in
pseudo or fully distributed mode??Also, if there is any need of this
switching quite often just have 2
sets of configuration files.

Regards,
Mohammad Tariq

On Wed, Aug 15, 2012 at 12:16 AM, Cristian Carranza <
[EMAIL PROTECTED]> wrote:

> Thanks again Mohammad!
>
> Please help me to go further on your advice, since I am not good dealing
> with hostnames and network conf...
>
> I am using a wired connection to the internet right now and can "ping
> myself" {ping <myhostname>} and IBI/Hadoop are running fine.
>
> But if I change to a wireless connection, I can neither ping myself
> anymore nor Hadoop.
>
> Having said that: What changes in network configuration files (hostname)
> and in /etc/hosts are necessary in order to ping myself again, this time
> with a wireless DHCP IP address?
>
> Really hope that this is not a dull question... but any help will be much
> appreciated.
>
>
> Cristián.
>
>
>
> ------------------------------
> From: [EMAIL PROTECTED]
> Date: Tue, 14 Aug 2012 19:50:28 +0530
>
> Subject: Re: Hello! - Hadoop: System Requirements.
> To: [EMAIL PROTECTED]
>
>
> If you don't want to use static IP, use the hostname everywhere in your
> configuration. But you need to modify the /etc/hosts file everytime to
> reflect the changes.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <
> [EMAIL PROTECTED]> wrote:
>
> Julien:
>
> Thanks for your prompt response. But...
> Is there a way to use Hadoop without a static IP address with a VM?
> Thanks!
>
>
> *From:* Julien Muller <[EMAIL PROTECTED]>
> *Sent:* Tuesday, August 14, 2012 11:05 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Hello! - Hadoop: System Requirements.
>
> if your purpose is learn / dev / demo, it would be a good idea to use a
> VM.
> You will not only be able to use a static IP, but also keep copies of
> working systems, make some tests, learn how to setup a cluster with only 1
> physical machine. And much more.
>
> Julien
>
> 2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>
>
> Hello all in this list!
>
> Thank you Harsh J for your help! I decided to post it again in order to
> properly identify myself in the archive list.
>
>
>
>
> My name is Cristián and I am trying to learn Hadoop and to use it in near
> future...
>
> I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic
> Edition, from IBM.
> But I am facing problems now that make me wonder if there are alternative
> ways to learn Hadoop.
>
> The biggest problem is that IBI demands a static IP address, and this is a
> tough requirement for me, since I travel a lot for business and always use
> IP address assigned via DHCP..
> Is there a way to use Hadoop without a static IP address?
>
> More general question: What are the system requirements for installation
> of Hadoop?
>
> Thank you in advance!
>
> Cristián Carranzal.
>
>
>
>
>

RE: Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-14, 22:51

Thanks Mohammad...

Yep, the problem is when IP gets changed... And this will be the rule since I travel a lot for business reasons (I am a quality consultant, hotels here and there...). Also I am testing/learning now in order to give a recommendation to my BI manager in near future... single node is enough for now...

I've added the wlan IP address to the /etc/hosts file, but it is still impossible to ping myself, but it seems that I am "almost there"...
because If I ping RHEL6 (hostname), I've got an error massage (Destination host unreachable)
but if I ping the wlan IP address, it is ok (but Hadoop refuses to start: "Failed to retrieve hostname/IP from RHEL6.ccet.ufrn.br"...)

I guess that an association between RHEL6 hostname to this two IP addresses is needed, but I do not know if this is possible...

Here it is the hosts file:

Hosts:
---------------------------------------------------
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
# wireless
10.9.6.160 RHEL6
# wired
10.9.0.188 RHEL6
------------------------------------------------------
Thanks again!

--------------------------------------------------------------------------------
From: [EMAIL PROTECTED]
Date: Wed, 15 Aug 2012 00:26:01 +0530
Subject: Re: Hello! - Hadoop: System Requirements.
To: [EMAIL PROTECTED]

Hello Cristian,
   No question is "dull"..I also do the same thing when stuck. Now,the reason behind your problem
is that when you switch from wired to wireless, the IP gets changed. Just use "ifconfig" command to
get the IP and paste it in your hosts file along with your hostname. BTW, are you using Hadoop in
pseudo or fully distributed mode??Also, if there is any need of this switching quite often just have 2
sets of configuration files.
Regards,
   Mohammad Tariq
On Wed, Aug 15, 2012 at 12:16 AM, Cristian Carranza <[EMAIL PROTECTED]> wrote:

  Thanks again Mohammad!

  Please help me to go further on your advice, since I am not good dealing with hostnames and network conf...

  I am using a wired connection to the internet right now and can "ping myself" {ping <myhostname>} and IBI/Hadoop are running fine.

  But if I change to a wireless connection, I can neither ping myself anymore nor Hadoop.

  Having said that: What changes in network configuration files (hostname) and in /etc/hosts are necessary in order to ping myself again, this time with a wireless DHCP IP address?

  Really hope that this is not a dull question... but any help will be much appreciated.
  Cristián.

------------------------------------------------------------------------------
  From: [EMAIL PROTECTED]
  Date: Tue, 14 Aug 2012 19:50:28 +0530

  Subject: Re: Hello! - Hadoop: System Requirements.

  To: [EMAIL PROTECTED]
  If you don't want to use static IP, use the hostname everywhere in your configuration. But you need to modify the /etc/hosts file everytime to reflect the changes.

  Regards,
   Mohammad Tariq
  On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <[EMAIL PROTECTED]> wrote:

   Julien:

   Thanks for your prompt response. But...
   Is there a way to use Hadoop without a static IP address with a VM?

   Thanks!
   From: Julien Muller
   Sent: Tuesday, August 14, 2012 11:05 AM
   To: [EMAIL PROTECTED]
   Subject: Re: Hello! - Hadoop: System Requirements.

   if your purpose is learn / dev / demo, it would be a good idea to use a VM.
   You will not only be able to use a static IP, but also keep copies of working systems, make some tests, learn how to setup a cluster with only 1 physical machine. And much more.

   Julien

   2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>

   Hello all in this list!

   Thank you Harsh J for your help! I decided to post it again in order to properly identify myself in the archive list.
   My name is Cristián and I am trying to learn Hadoop and to use it in near future...

   I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic Edition, from IBM.
   But I am facing problems now that make me wonder if there are alternative ways to learn Hadoop.

   The biggest problem is that IBI demands a static IP address, and this is a tough requirement for me, since I travel a lot for business and always use IP address assigned via DHCP..
   Is there a way to use Hadoop without a static IP address?

   More general question: What are the system requirements for installation of Hadoop?

   Thank you in advance!

   Cristián Carranzal.

Re: Hello! - Hadoop: System Requirements.

Jeffrey Silverman 2012-08-14, 23:24

Cristian,

You have a basic network problem. You have a single name, RHEL, which
points to two IP addresses, 10.9.6.160 and 10.9.0.188. That won't work.
The /etc/hosts file is searched sequentially so it always finds the
first occurrence of RHEL.

By default, any process that listens on all interfaces will listen on the
loopback interface ( 127.0.0.1).

You have an additional problem and that is that wherever you go, your IP
address is going to change. There is a document on the subject, RFC 1918.
Basically, any IP address that begins with 10., 172.12 through 172.31, and
192.168 is a private address. You're getting the 10.9.6.180 and 10.9.0.188
addresses from the network, and that's unusual but perfectly legitimate.

If you are only going to use these two addresses, then what you can do is
add the following to your /etc/hosts file:

# wireless
10.9.6.160 RHEL6_wireless
# wired
10.9.0.188 RHEL6_wired

When your systems attempt to connect to the wired IP address and you are
running in wireless mode, then the connection attempt will fail and the
map/reduce software won't send any work to. Similarly, if you attempt to
connect to the wireless IP address and you are wired.
Jeff Silverman
Google

RE: Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-16, 14:10

Jeff:

Thank you for your explanation.
The problem was indeed basic, but it is solved now.
I asked for a permission to have a static IP address from the University where my wife works. But next Sunday I will be out for two weeks and I wish to continue learning Hadoop from the hotel, where only wireless DHCP IP addresses are available.

Thanks to Mohammad and Harsh for their time too.

Cristián.
Date: Tue, 14 Aug 2012 16:24:39 -0700
Subject: Re: Hello! - Hadoop: System Requirements.
From: [EMAIL PROTECTED]
To: [EMAIL PROTECTED]

Cristian,
You have a basic network problem. You have a single name, RHEL, which points to two IP addresses, 10.9.6.160 and 10.9.0.188. That won't work. The /etc/hosts file is searched sequentially so it always finds the first occurrence of RHEL.

By default, any process that listens on all interfaces will listen on the loopback interface ( 127.0.0.1).
You have an additional problem and that is that wherever you go, your IP address is going to change. There is a document on the subject, RFC 1918. Basically, any IP address that begins with 10., 172.12 through 172.31, and 192.168 is a private address. You're getting the 10.9.6.180 and 10.9.0.188 addresses from the network, and that's unusual but perfectly legitimate.

If you are only going to use these two addresses, then what you can do is add the following to your /etc/hosts file:
# wireless

10.9.6.160 RHEL6_wireless# wired
10.9.0.188 RHEL6_wired
When your systems attempt to connect to the wired IP address and you are running in wireless mode, then the connection attempt will fail and the map/reduce software won't send any work to. Similarly, if you attempt to connect to the wireless IP address and you are wired.
Jeff SilvermanGoogle

Re: Hello! - Hadoop: System Requirements.

Mohammad Tariq 2012-08-15, 00:41

You can visit this link, if you need some help on how to configure Hadoop
in pseudo mode :
http://cloudfront.blogspot.in/2012/07/how-to-configure-hadoop.html

Regards,
Mohammad Tariq

On Wed, Aug 15, 2012 at 4:54 AM, Jeffrey Silverman <[EMAIL PROTECTED]
> wrote:

> Cristian,
>
> You have a basic network problem. You have a single name, RHEL, which
> points to two IP addresses, 10.9.6.160 and 10.9.0.188. That won't work.
> The /etc/hosts file is searched sequentially so it always finds the
> first occurrence of RHEL.
>
> By default, any process that listens on all interfaces will listen on the
> loopback interface ( 127.0.0.1).
>
> You have an additional problem and that is that wherever you go, your IP
> address is going to change. There is a document on the subject, RFC 1918.
> Basically, any IP address that begins with 10., 172.12 through 172.31, and
> 192.168 is a private address. You're getting the 10.9.6.180 and 10.9.0.188
> addresses from the network, and that's unusual but perfectly legitimate.
>
> If you are only going to use these two addresses, then what you can do is
> add the following to your /etc/hosts file:
>
> # wireless
> 10.9.6.160 RHEL6_wireless
> # wired
> 10.9.0.188 RHEL6_wired
>
> When your systems attempt to connect to the wired IP address and you are
> running in wireless mode, then the connection attempt will fail and the
> map/reduce software won't send any work to. Similarly, if you attempt to
> connect to the wireless IP address and you are wired.
>
>
> Jeff Silverman
> Google
>
>

RE: Hello! - Hadoop: System Requirements.

Harsh J 2012-08-14, 22:57

Can you not bind all your services, including Hadoop, to the localhost
interface? That usually works for my pseudo instances.
On Aug 15, 2012 4:22 AM, "Cristian Carranza" <[EMAIL PROTECTED]>
wrote:

> Thanks Mohammad...
>
> Yep, the problem is when IP gets changed... And this will be the rule
> since I travel a lot for business reasons (I am a quality consultant,
> hotels here and there...). Also I am testing/learning now in order to give
> a recommendation to my BI manager in near future... single node is enough
> for now...
>
> I've added the wlan IP address to the /etc/hosts file, but it is still
> impossible to ping myself, but it seems that I am "almost there"...
> because If I ping RHEL6 (hostname), I've got an error massage (Destination
> host unreachable)
> but if I ping the wlan IP address, it is ok (but Hadoop refuses to start:
> "Failed to retrieve hostname/IP from RHEL6.ccet.ufrn.br"...)
>
> I guess that an association between RHEL6 hostname to this two IP
> addresses is needed, but I do not know if this is possible...
>
> Here it is the hosts file:
>
> Hosts:
> ---------------------------------------------------
> 127.0.0.1 localhost localhost.localdomain localhost4
> localhost4.localdomain4
> ::1 localhost localhost.localdomain localhost6
> localhost6.localdomain6
> # wireless
> 10.9.6.160 RHEL6
> # wired
> 10.9.0.188 RHEL6
> ------------------------------------------------------
>
>
> Thanks again!
>
>
>
> ------------------------------
> From: [EMAIL PROTECTED]
> Date: Wed, 15 Aug 2012 00:26:01 +0530
> Subject: Re: Hello! - Hadoop: System Requirements.
> To: [EMAIL PROTECTED]
>
> Hello Cristian,
>
> No question is "dull"..I also do the same thing when stuck. Now,the
> reason behind your problem
> is that when you switch from wired to wireless, the IP gets changed. Just
> use "ifconfig" command to
> get the IP and paste it in your hosts file along with your hostname. BTW,
> are you using Hadoop in
> pseudo or fully distributed mode??Also, if there is any need of this
> switching quite often just have 2
> sets of configuration files.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Wed, Aug 15, 2012 at 12:16 AM, Cristian Carranza <
> [EMAIL PROTECTED]> wrote:
>
> Thanks again Mohammad!
>
> Please help me to go further on your advice, since I am not good dealing
> with hostnames and network conf...
>
> I am using a wired connection to the internet right now and can "ping
> myself" {ping <myhostname>} and IBI/Hadoop are running fine.
>
> But if I change to a wireless connection, I can neither ping myself
> anymore nor Hadoop.
>
> Having said that: What changes in network configuration files (hostname)
> and in /etc/hosts are necessary in order to ping myself again, this time
> with a wireless DHCP IP address?
>
> Really hope that this is not a dull question... but any help will be much
> appreciated.
>
>
> Cristián.
>
>
>
> ------------------------------
> From: [EMAIL PROTECTED]
> Date: Tue, 14 Aug 2012 19:50:28 +0530
>
> Subject: Re: Hello! - Hadoop: System Requirements.
> To: [EMAIL PROTECTED]
>
>
> If you don't want to use static IP, use the hostname everywhere in your
> configuration. But you need to modify the /etc/hosts file everytime to
> reflect the changes.
>
> Regards,
> Mohammad Tariq
>
>
>
> On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <
> [EMAIL PROTECTED]> wrote:
>
> Julien:
>
> Thanks for your prompt response. But...
> Is there a way to use Hadoop without a static IP address with a VM?
> Thanks!
>
>
> *From:* Julien Muller <[EMAIL PROTECTED]>
> *Sent:* Tuesday, August 14, 2012 11:05 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Hello! - Hadoop: System Requirements.
>
> if your purpose is learn / dev / demo, it would be a good idea to use a
> VM.
> You will not only be able to use a static IP, but also keep copies of
> working systems, make some tests, learn how to setup a cluster with only 1
> physical machine. And much more.

Re: Hello! - Hadoop: System Requirements.

Cristian Carranza 2012-08-14, 23:16

Thanks Harsh J!

But never heard about binding services to localhost... How can I do that? Could you be so kind to point to a website or the like in order to learn “how to”?
As you already know... I am trying to become a “newbie”...

Thanks!
From: Harsh J
Sent: Tuesday, August 14, 2012 7:57 PM
To: [EMAIL PROTECTED]
Subject: RE: Hello! - Hadoop: System Requirements.

Can you not bind all your services, including Hadoop, to the localhost interface? That usually works for my pseudo instances.

On Aug 15, 2012 4:22 AM, "Cristian Carranza" <[EMAIL PROTECTED]> wrote:

  Thanks Mohammad...

  Yep, the problem is when IP gets changed... And this will be the rule since I travel a lot for business reasons (I am a quality consultant, hotels here and there...). Also I am testing/learning now in order to give a recommendation to my BI manager in near future... single node is enough for now...

  I've added the wlan IP address to the /etc/hosts file, but it is still impossible to ping myself, but it seems that I am "almost there"...
  because If I ping RHEL6 (hostname), I've got an error massage (Destination host unreachable)
  but if I ping the wlan IP address, it is ok (but Hadoop refuses to start: "Failed to retrieve hostname/IP from RHEL6.ccet.ufrn.br"...)

  I guess that an association between RHEL6 hostname to this two IP addresses is needed, but I do not know if this is possible...

  Here it is the hosts file:

  Hosts:
  ---------------------------------------------------
  127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
  ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
  # wireless
  10.9.6.160 RHEL6
  # wired
  10.9.0.188 RHEL6
  ------------------------------------------------------
  Thanks again!

------------------------------------------------------------------------------
  From: [EMAIL PROTECTED]
  Date: Wed, 15 Aug 2012 00:26:01 +0530
  Subject: Re: Hello! - Hadoop: System Requirements.
  To: [EMAIL PROTECTED]

  Hello Cristian,
   No question is "dull"..I also do the same thing when stuck. Now,the reason behind your problem
  is that when you switch from wired to wireless, the IP gets changed. Just use "ifconfig" command to
  get the IP and paste it in your hosts file along with your hostname. BTW, are you using Hadoop in
  pseudo or fully distributed mode??Also, if there is any need of this switching quite often just have 2
  sets of configuration files.
  Regards,
   Mohammad Tariq
  On Wed, Aug 15, 2012 at 12:16 AM, Cristian Carranza <[EMAIL PROTECTED]> wrote:

   Thanks again Mohammad!

   Please help me to go further on your advice, since I am not good dealing with hostnames and network conf...

   I am using a wired connection to the internet right now and can "ping myself" {ping <myhostname>} and IBI/Hadoop are running fine.

   But if I change to a wireless connection, I can neither ping myself anymore nor Hadoop.

   Having said that: What changes in network configuration files (hostname) and in /etc/hosts are necessary in order to ping myself again, this time with a wireless DHCP IP address?

   Really hope that this is not a dull question... but any help will be much appreciated.
   Cristián.

----------------------------------------------------------------------------
   From: [EMAIL PROTECTED]
   Date: Tue, 14 Aug 2012 19:50:28 +0530

   Subject: Re: Hello! - Hadoop: System Requirements.

   To: [EMAIL PROTECTED]
   If you don't want to use static IP, use the hostname everywhere in your configuration. But you need to modify the /etc/hosts file everytime to reflect the changes.

   Regards,
   Mohammad Tariq
   On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <[EMAIL PROTECTED]> wrote:

   Julien:

   Thanks for your prompt response. But...
   Is there a way to use Hadoop without a static IP address with a VM?

   Thanks!
   From: Julien Muller
   Sent: Tuesday, August 14, 2012 11:05 AM
   To: [EMAIL PROTECTED]
   Subject: Re: Hello! - Hadoop: System Requirements.

   if your purpose is learn / dev / demo, it would be a good idea to use a VM.
   You will not only be able to use a static IP, but also keep copies of working systems, make some tests, learn how to setup a cluster with only 1 physical machine. And much more.

   Julien

   2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>

   Hello all in this list!

   Thank you Harsh J for your help! I decided to post it again in order to properly identify myself in the archive list.
   My name is Cristián and I am trying to learn Hadoop and to use it in near future...

   I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic Edition, from IBM.
   But I am facing problems now that make me wonder if there are alternative ways to learn Hadoop.

   The biggest problem is that IBI demands a static IP address, and this is a tough requirement for me, since I travel a lot for business and always use IP address assigned via DHCP..
   Is there a way to use Hadoop without a static IP address?

   More general question: What are the system requirements for installation of Hadoop?

   Thank you in advance!

   Cristián Carranzal.

Re: Hello! - Hadoop: System Requirements.

Mohammad Tariq 2012-08-14, 23:03

I agree with Harsh..You are anyway using Hadoop in pseudo mode..And it is
also obvious that your actual cluster is gonna be stationary. So need of
manipulating the hosts file there.

Regards,
Mohammad Tariq

On Wed, Aug 15, 2012 at 4:27 AM, Harsh J <[EMAIL PROTECTED]> wrote:

> Can you not bind all your services, including Hadoop, to the localhost
> interface? That usually works for my pseudo instances.
> On Aug 15, 2012 4:22 AM, "Cristian Carranza" <
> [EMAIL PROTECTED]> wrote:
>
>> Thanks Mohammad...
>>
>> Yep, the problem is when IP gets changed... And this will be the rule
>> since I travel a lot for business reasons (I am a quality consultant,
>> hotels here and there...). Also I am testing/learning now in order to give
>> a recommendation to my BI manager in near future... single node is enough
>> for now...
>>
>> I've added the wlan IP address to the /etc/hosts file, but it is still
>> impossible to ping myself, but it seems that I am "almost there"...
>> because If I ping RHEL6 (hostname), I've got an error massage
>> (Destination host unreachable)
>> but if I ping the wlan IP address, it is ok (but Hadoop refuses to start:
>> "Failed to retrieve hostname/IP from RHEL6.ccet.ufrn.br"...)
>>
>> I guess that an association between RHEL6 hostname to this two IP
>> addresses is needed, but I do not know if this is possible...
>>
>> Here it is the hosts file:
>>
>> Hosts:
>> ---------------------------------------------------
>> 127.0.0.1 localhost localhost.localdomain localhost4
>> localhost4.localdomain4
>> ::1 localhost localhost.localdomain localhost6
>> localhost6.localdomain6
>> # wireless
>> 10.9.6.160 RHEL6
>> # wired
>> 10.9.0.188 RHEL6
>> ------------------------------------------------------
>>
>>
>> Thanks again!
>>
>>
>>
>> ------------------------------
>> From: [EMAIL PROTECTED]
>> Date: Wed, 15 Aug 2012 00:26:01 +0530
>> Subject: Re: Hello! - Hadoop: System Requirements.
>> To: [EMAIL PROTECTED]
>>
>> Hello Cristian,
>>
>> No question is "dull"..I also do the same thing when stuck. Now,the
>> reason behind your problem
>> is that when you switch from wired to wireless, the IP gets changed. Just
>> use "ifconfig" command to
>> get the IP and paste it in your hosts file along with your hostname. BTW,
>> are you using Hadoop in
>> pseudo or fully distributed mode??Also, if there is any need of this
>> switching quite often just have 2
>> sets of configuration files.
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Wed, Aug 15, 2012 at 12:16 AM, Cristian Carranza <
>> [EMAIL PROTECTED]> wrote:
>>
>> Thanks again Mohammad!
>>
>> Please help me to go further on your advice, since I am not good dealing
>> with hostnames and network conf...
>>
>> I am using a wired connection to the internet right now and can "ping
>> myself" {ping <myhostname>} and IBI/Hadoop are running fine.
>>
>> But if I change to a wireless connection, I can neither ping myself
>> anymore nor Hadoop.
>>
>> Having said that: What changes in network configuration files (hostname)
>> and in /etc/hosts are necessary in order to ping myself again, this time
>> with a wireless DHCP IP address?
>>
>> Really hope that this is not a dull question... but any help will be much
>> appreciated.
>>
>>
>> Cristián.
>>
>>
>>
>> ------------------------------
>> From: [EMAIL PROTECTED]
>> Date: Tue, 14 Aug 2012 19:50:28 +0530
>>
>> Subject: Re: Hello! - Hadoop: System Requirements.
>> To: [EMAIL PROTECTED]
>>
>>
>> If you don't want to use static IP, use the hostname everywhere in your
>> configuration. But you need to modify the /etc/hosts file everytime to
>> reflect the changes.
>>
>> Regards,
>> Mohammad Tariq
>>
>>
>>
>> On Tue, Aug 14, 2012 at 7:43 PM, Cristian Carranza <
>> [EMAIL PROTECTED]> wrote:
>>
>> Julien:
>>
>> Thanks for your prompt response. But...
>> Is there a way to use Hadoop without a static IP address with a VM?
>> Thanks!
>>
>>
>> *From:* Julien Muller <[EMAIL PROTECTED]>

Re: Hello! - Hadoop: System Requirements.

Mohammad Tariq 2012-08-14, 14:11

Hello Cristian,

I would suggest you to begin with a pseudo-distributed setup. And once
you are comfortable with the settings and configuration procedure, extend
it to the fully-distributed setup. As far as requirements are concerned,
it's always better to have a Linux machine with Oracle Java and ssh
configured on it.

Regards,
Mohammad Tariq

On Tue, Aug 14, 2012 at 7:35 PM, Julien Muller <[EMAIL PROTECTED]>wrote:

> if your purpose is learn / dev / demo, it would be a good idea to use a VM.
> You will not only be able to use a static IP, but also keep copies of
> working systems, make some tests, learn how to setup a cluster with only 1
> physical machine. And much more.
>
> Julien
>
> 2012/8/14 Cristian Carranza <[EMAIL PROTECTED]>
>
>> Hello all in this list!
>>
>> Thank you Harsh J for your help! I decided to post it again in order to
>> properly identify myself in the archive list.
>>
>>
>>
>>
>> My name is Cristián and I am trying to learn Hadoop and to use it in near
>> future...
>>
>> I’ve started to learn Hadoop via Infosphere BigInsights (IBI), Basic
>> Edition, from IBM.
>> But I am facing problems now that make me wonder if there are alternative
>> ways to learn Hadoop.
>>
>> The biggest problem is that IBI demands a static IP address, and this is
>> a tough requirement for me, since I travel a lot for business and always
>> use IP address assigned via DHCP..
>> Is there a way to use Hadoop without a static IP address?
>>
>> More general question: What are the system requirements for installation
>> of Hadoop?
>>
>> Thank you in advance!
>>
>> Cristián Carranzal.
>>
>
>