Thanks for the information,

Now I am trying to install hadoop dfs using 2 nodes. A namenode cum datanode, and a separate data node. I use the following configuration for my hdfs-site.xml

<configuration>

  <property>
    <name>fs.default.name</name>
    <value>localhost:9000</value>
  </property>

  <property>
    <name>dfs.data.dir</name>
    <value>/home/bala/data</value>
  </property>

  <property>
    <name>dfs.name.dir</name>
    <value>/home/bala/name</value>
  </property>
</configuration>
In namenode, I have added the datanode hostnames (machine1 and machine2).
When I do 'start-all.sh', I see the log that the data node is starting in both the machines but I went to the browser in the namenode, I see only one live node. (That is the namenode which is configured as datanode)

Any hint here will help me
With regards
Bala

From: Mahesh Balija [mailto:[EMAIL PROTECTED]]
Sent: 05 March 2013 14:15
To: [EMAIL PROTECTED]
Subject: Re: Hadoop file system

You can be able to use Hdfs alone in the distributed mode to fulfill your requirement.
Hdfs has the Filesystem java api through which you can interact with the HDFS from your client.
HDFS is good if you have less number of files with huge size rather than you having many files with small size.

Best,
Mahesh Balija,
Calsoft Labs.
On Tue, Mar 5, 2013 at 10:43 AM, AMARNATH, Balachandar <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Hi,

I am new to hdfs. In my java application, I need to perform 'similar operation' over large number of files. I would like to store those files in distributed machines. I don't think, I will need map reduce paradigm. But however I would like to use HDFS for file storage and access. Is it possible (or nice idea) to use HDFS as a stand alone stuff? And, java APIs are available to work with HDFS so that I can read/write in distributed environment ? Any thoughts here will be helpful.
With thanks and regards
Balachandar
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

I fixed it the below issue :)
Regards
Bala

From: AMARNATH, Balachandar [mailto:[EMAIL PROTECTED]]
Sent: 05 March 2013 17:05
To: [EMAIL PROTECTED]
Subject: Hadoop cluster setup - could not see second datanode

Thanks for the information,

Now I am trying to install hadoop dfs using 2 nodes. A namenode cum datanode, and a separate data node. I use the following configuration for my hdfs-site.xml

<configuration>

  <property>
    <name>fs.default.name</name>
    <value>localhost:9000</value>
  </property>

  <property>
    <name>dfs.data.dir</name>
    <value>/home/bala/data</value>
  </property>

  <property>
    <name>dfs.name.dir</name>
    <value>/home/bala/name</value>
  </property>
</configuration>
In namenode, I have added the datanode hostnames (machine1 and machine2).
When I do 'start-all.sh', I see the log that the data node is starting in both the machines but I went to the browser in the namenode, I see only one live node. (That is the namenode which is configured as datanode)

Any hint here will help me
With regards
Bala

From: Mahesh Balija [mailto:[EMAIL PROTECTED]]
Sent: 05 March 2013 14:15
To: [EMAIL PROTECTED]
Subject: Re: Hadoop file system

You can be able to use Hdfs alone in the distributed mode to fulfill your requirement.
Hdfs has the Filesystem java api through which you can interact with the HDFS from your client.
HDFS is good if you have less number of files with huge size rather than you having many files with small size.

Best,
Mahesh Balija,
Calsoft Labs.
On Tue, Mar 5, 2013 at 10:43 AM, AMARNATH, Balachandar <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Hi,

I am new to hdfs. In my java application, I need to perform 'similar operation' over large number of files. I would like to store those files in distributed machines. I don't think, I will need map reduce paradigm. But however I would like to use HDFS for file storage and access. Is it possible (or nice idea) to use HDFS as a stand alone stuff? And, java APIs are available to work with HDFS so that I can read/write in distributed environment ? Any thoughts here will be helpful.
With thanks and regards
Balachandar
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.
Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.
All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

Although Hadoop is designed and developed for distributed computing it can be run on a single node in pseudo distributed mode and with multiple data node on single machine . Developers often run multiple data nodes on single node to develop and test distributed features,data node behavior, Name node interaction with data node and for other reasons.

Please go through following blog for same..

http://www.blogger.com/blogger.g?blogID=2277703965936900657#editor/target=post;postID=8231904039775612388
________________________________
From: Robert Evans [[EMAIL PROTECTED]]
Sent: Tuesday, March 05, 2013 11:57 PM
To: [EMAIL PROTECTED]
Subject: Re: Hadoop cluster setup - could not see second datanode

Why would you need several data nodes?  It is simple to have one data node and one name node on the same machine.  I believe that you can make multiple data nodes run on the same machine, but it would take quite a bit of configuration work to do it, and it would only really be helpful for you to do some very specific testing involving multiple data nodes.

--Bobby

From: 卖报的小行家 <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Reply-To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Tuesday, March 5, 2013 8:41 AM
To: user <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Subject: Re:RE: Hadoop cluster setup - could not see second datanode

Hello,
Can  Namenode and several datanodes exist in one machine?
I only have one PC. I want to configure it like this way.

BRs//Julian
------------------ Original ------------------
From:  "AMARNATH, Balachandar"<[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>;
Date:  Tue, Mar 5, 2013 07:55 PM
To:  "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>"<[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>;
Subject:  RE: Hadoop cluster setup - could not see second datanode

I fixed it the below issue :)
Regards
Bala

From: AMARNATH, Balachandar [mailto:[EMAIL PROTECTED]]
Sent: 05 March 2013 17:05
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Hadoop cluster setup - could not see second datanode

Thanks for the information,

Now I am trying to install hadoop dfs using 2 nodes. A namenode cum datanode, and a separate data node. I use the following configuration for my hdfs-site.xml

<configuration>

  <property>
    <name>fs.default.name</name>
    <value>localhost:9000</value>
  </property>

  <property>
    <name>dfs.data.dir</name>
    <value>/home/bala/data</value>
  </property>

  <property>
    <name>dfs.name.dir</name>
    <value>/home/bala/name</value>
  </property>
</configuration>
In namenode, I have added the datanode hostnames (machine1 and machine2).
When I do ‘start-all.sh’, I see the log that the data node is starting in both the machines but I went to the browser in the namenode, I see only one live node. (That is the namenode which is configured as datanode)

Any hint here will help me
With regards
Bala

From: Mahesh Balija [mailto:[EMAIL PROTECTED]]
Sent: 05 March 2013 14:15
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: Hadoop file system

You can be able to use Hdfs alone in the distributed mode to fulfill your requirement.
Hdfs has the Filesystem java api through which you can interact with the HDFS from your client.
HDFS is good if you have less number of files with huge size rather than you having many files with small size.

Best,
Mahesh Balija,
Calsoft Labs.
On Tue, Mar 5, 2013 at 10:43 AM, AMARNATH, Balachandar <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Hi,

I am new to hdfs. In my java application, I need to perform ‘similar operation’ over large number of files. I would like to store those files in distributed machines. I don’t think, I will need map reduce paradigm. But however I would like to use HDFS for file storage and access. Is it possible (or nice idea) to use HDFS as a stand alone stuff? And, java APIs are available to work with HDFS so that I can read/write in distributed environment ? Any thoughts here will be helpful.
With thanks and regards
Balachandar
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.
The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.

If you are not the intended recipient, please notify Airbus immediately and delete this e-mail.

Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately.

All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised.
If you are not the intended recipient, please notify Airbus immediately and delete this e-mai

1) check whehter you can ssh to other node from  namenode

set your configuration carefully

<property>****

<name>fs.default.name</name>****

<value>localhost:9000</value>****

</property>

replace localhost with name node having namnode ruuning and shoulde
resolvable (try ping to that node from other node)

**

2)  go to conf/slaves file

   check it has following lines

  1. namnodeip

   2. datanodeip

On Wed, Mar 6, 2013 at 9:29 AM, Brahma Reddy Battula <
[EMAIL PROTECTED]> wrote:

>  Although Hadoop is designed and developed for distributed computing it
> can be run on a single node in pseudo distributed mode and with multiple
> data node on single machine . Developers often run multiple data nodes on
> single node to develop and test distributed features,data node behavior,
> Name node interaction with data node and for other reasons.
>
>  Please go through following blog for same..
>
>
> http://www.blogger.com/blogger.g?blogID=2277703965936900657#editor/target=post;postID=8231904039775612388
>  ------------------------------
> *From:* Robert Evans [[EMAIL PROTECTED]]
> *Sent:* Tuesday, March 05, 2013 11:57 PM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Hadoop cluster setup - could not see second datanode
>
>   Why would you need several data nodes?  It is simple to have one data
> node and one name node on the same machine.  I believe that you can make
> multiple data nodes run on the same machine, but it would take quite a bit
> of configuration work to do it, and it would only really be helpful for you
> to do some very specific testing involving multiple data nodes.
>
>  --Bobby
>
>   From: 卖报的小行家 <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Tuesday, March 5, 2013 8:41 AM
> To: user <[EMAIL PROTECTED]>
> Subject: Re:RE: Hadoop cluster setup - could not see second datanode
>
>   Hello,
> Can  Namenode and several datanodes exist in one machine?
> I only have one PC. I want to configure it like this way.
>
>  BRs//Julian
>
>
>  ------------------ Original ------------------
>  *From: * "AMARNATH, Balachandar"<[EMAIL PROTECTED]>;
> *Date: * Tue, Mar 5, 2013 07:55 PM
> *To: * "[EMAIL PROTECTED]"<[EMAIL PROTECTED]>; **
>  *Subject: * RE: Hadoop cluster setup - could not see second datanode
>
>  I fixed it the below issue J
>
>
>
>
>
> Regards
>
> Bala
>
>
>
> *From:* AMARNATH, Balachandar [mailto:[EMAIL PROTECTED]<[EMAIL PROTECTED]>]
>
> *Sent:* 05 March 2013 17:05
> *To:* [EMAIL PROTECTED]
> *Subject:* Hadoop cluster setup - could not see second datanode
>
>
>
> Thanks for the information,
>
>
>
> Now I am trying to install hadoop dfs using 2 nodes. A namenode cum
> datanode, and a separate data node. I use the following configuration for
> my hdfs-site.xml
>
>
>
> <configuration>
>
>
>
>   <property>
>
>     <name>fs.default.name</name>
>
>     <value>localhost:9000</value>
>
>   </property>
>
>
>
>   <property>
>
>     <name>dfs.data.dir</name>
>
>     <value>/home/bala/data</value>
>
>   </property>
>
>
>
>   <property>
>
>     <name>dfs.name.dir</name>
>
>     <value>/home/bala/name</value>
>
>   </property>
>
> </configuration>
>
>
>
>
>
> In namenode, I have added the datanode hostnames (machine1 and machine2).
>
> When I do ‘start-all.sh’, I see the log that the data node is starting in
> both the machines but I went to the browser in the namenode, I see only one
> live node. (That is the namenode which is configured as datanode)
>
>
>
> Any hint here will help me
>
>
>
>
>
> With regards
>
> Bala
>
>
>
>
>
>
>
>
>
>
>
> *From:* Mahesh Balija [mailto:[EMAIL PROTECTED]<[EMAIL PROTECTED]>]
>
> *Sent:* 05 March 2013 14:15
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Hadoop file system
>
>
>
> You can be able to use Hdfs alone in the distributed mode to fulfill your
> requirement.
> Hdfs has the Filesystem java api through which you can interact with the
> HDFS from your client.
*
*
*

Thanx and Regards*
* Vikas Jadhav*