Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - Run multiple HDFS instances


+
Lixiang Ao 2013-04-18, 09:04
+
Lixiang Ao 2013-04-18, 15:29
Copy link to this message
-
Re: Run multiple HDFS instances
Chris Embree 2013-04-18, 15:52
Glad you got this working... can you explain your use case a little?   I'm
trying to understand why you might want to do that.
On Thu, Apr 18, 2013 at 11:29 AM, Lixiang Ao <[EMAIL PROTECTED]> wrote:

> I modified sbin/hadoop-daemon.sh, where HADOOP_PID_DIR is set. It works!
>  Everything looks fine now.
>
> Seems direct command "hdfs namenode" gives a better sense of control  :)
>
> Thanks a lot.
>
> 在 2013年4月18日星期四,Harsh J 写道:
>
> Yes you can but if you want the scripts to work, you should have them
>> use a different PID directory (I think its called HADOOP_PID_DIR)
>> every time you invoke them.
>>
>> I instead prefer to start the daemons up via their direct command such
>> as "hdfs namenode" and so and move them to the background, with a
>> redirect for logging.
>>
>> On Thu, Apr 18, 2013 at 2:34 PM, Lixiang Ao <[EMAIL PROTECTED]> wrote:
>> > Hi all,
>> >
>> > Can I run mutiple HDFS instances, that is, n seperate namenodes and n
>> > datanodes, on a single machine?
>> >
>> > I've modified core-site.xml and hdfs-site.xml to avoid port and file
>> > conflicting between HDFSes, but when I started the second HDFS, I got
>> the
>> > errors:
>> >
>> > Starting namenodes on [localhost]
>> > localhost: namenode running as process 20544. Stop it first.
>> > localhost: datanode running as process 20786. Stop it first.
>> > Starting secondary namenodes [0.0.0.0]
>> > 0.0.0.0: secondarynamenode running as process 21074. Stop it first.
>> >
>> > Is there a way to solve this?
>> > Thank you in advance,
>> >
>> > Lixiang Ao
>>
>>
>>
>> --
>> Harsh J
>>
>
+
Lixiang Ao 2013-04-18, 16:32
+
Hemanth Yamijala 2013-04-19, 04:01
+
Lixiang Ao 2013-04-19, 04:20