Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Can you help me to install HDFS Federation and test?


+
Oh Seok Keun 2013-09-11, 09:37
+
Visioner Sadak 2013-09-11, 10:04
+
Sandeep L 2013-09-17, 09:14
+
Visioner Sadak 2013-09-17, 12:26
+
Visioner Sadak 2013-09-18, 11:28
Copy link to this message
-
Re: Can you help me to install HDFS Federation and test?
Visioner Sadak 2013-09-21, 18:16
sryy for late reply just checked my mail today are you using client side
mount table just as mentioned in the doc which u reffered  if u r using
client side mount table configurations in u r core-site.xml u wont be able
to create directory in that case first create folder without client
side-mountable configurations then once folders are created u can again
include client side-mountable configurations  and restart namenode,datanode
and all daemons..by the way which version u r trying to install
On Thu, Sep 19, 2013 at 12:00 PM, Sandeep L <[EMAIL PROTECTED]>wrote:

> No its not appearing from other name node.
>
> Here is the procedure I followed:
> In NameNode1 I ran following commands
> bin/hdfs dfs -mkdir test
> bin/hdfs dfs -put dummy.txt test
>
> When ran bin/hdfs -ls test command from NameNode1 its listing file fin
> hdfs but if I ran same command from NameNode2 out put is "ls: test : No
> such file or directory"
>
>
> Thanks,
> Sandeep.
>
>
> ------------------------------
> Date: Wed, 18 Sep 2013 16:58:50 +0530
>
> Subject: Re: Can you help me to install HDFS Federation and test?
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> It shud be visible from every namenode machine have you tried this commmand
>
>  bin/hdfs dfs -ls /yourdirectoryname/
>
>
> On Wed, Sep 18, 2013 at 9:23 AM, Sandeep L <[EMAIL PROTECTED]>wrote:
>
> Hi,
>
> I resolved the issue.
> There is some problem with /etc/hosts file.
>
> One more question I would like to ask is:
>
> I created a directory in HDFS of NameNode1 and copied a file into it. My
> question is did it visible when I ran *hadoop fs -ls <PathToDirectory> *from
> NameNode2 machine?
> For me its not visible, can you explain with bit detailed.
>
> Thanks,
> Sandeep.
>
>
> ------------------------------
> Date: Tue, 17 Sep 2013 17:56:00 +0530
>
> Subject: Re: Can you help me to install HDFS Federation and test?
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> 1.> make sure to check hadoop logs once u start u r datanode at
> /home/hadoop/hadoop-version(your)/logs
> 2.> make sure all the datanodes are mentioned in slaves file and slaves
> file is placed on all machines
> 3.> check which datanode is not available check log file of that machine
> are both the  machines able to do a passwordless
> ssh with each other
> 4.> check your etc/hosts file make sure all your node machines ip is
> mentioned there
> 5.> make sure you have datanode folder created as mentioned in config
> file......
>
> let me know if u have any problem......
>
>
> On Tue, Sep 17, 2013 at 2:44 PM, Sandeep L <[EMAIL PROTECTED]>wrote:
>
> Hi,
>
> I tried to install HDFS federation with the help of document given by you.
>
> I have small issue.
> I used 2 slave in setup, both will act as namenode and datanode.
> Now the issue is when I am looking at home pages of both namenodes only
> one datanode is appearing.
> As per my understanding 2 datanodes should appear in both namenodes home
> pages.
>
> Can you please let me if am missing any thing?
>
> Thanks,
> Sandeep.
>
>
> ------------------------------
> Date: Wed, 11 Sep 2013 15:34:38 +0530
> Subject: Re: Can you help me to install HDFS Federation and test?
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
>
> may be this can help you ....
>
>
> On Wed, Sep 11, 2013 at 3:07 PM, Oh Seok Keun <[EMAIL PROTECTED]> wrote:
>
> Hello~ I am Rho working in korea
>
> I am trying to install HDFS Federation( with 2.1.0 beta version ) and to
> test
> After 2.1.0 ( for federation  test ) install I have a big trouble when
> file putting test
>
>
> I command to hadoop
> Can you help me to install HDFS Federation and test?
> ./bin/hadoop fs -put test.txt /NN1/
>
> there is error message
> "put: Renames across FileSystems not supported"
>
> But ./bin/hadoop fs -put test.txt hdfs://namnode:8020/NN1/  is ok
>
> Why this is happen? This is very sad to me ^^
> Can you explain why this is happend and give me solution?
>
>
> Additionally