Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Hadoop with S3 instead of local storage


+
Alok Kumar 2012-08-02, 07:14
Copy link to this message
-
Re: Hadoop with S3 instead of local storage
With S3 you do not need a NameNode. NameNode is part of HDFS.

On Thu, Aug 2, 2012 at 12:44 PM, Alok Kumar <[EMAIL PROTECTED]> wrote:
> Hi,
>
> Followed instructions from this link for setup
> http://wiki.apache.org/hadoop/AmazonS3.
>
> my "core-site.xml " contains only these 3 properties :
> <property>
>   <name>fs.default.name</name>
>   <value>s3://BUCKET</value>
> </property>
>
> <property>
>   <name>fs.s3.awsAccessKeyId</name>
>   <value>ID</value>
> </property>
>
> <property>
>   <name>fs.s3.awsSecretAccessKey</name>
>   <value>SECRET</value>
> </property>
>
> hdfs-site.xml is empty!
>
> Namenode log says, its trying to connect to local HDFS not S3.
> Am i missing anything?
>
> Regards,
> Alok

--
Harsh J
+
Alok Kumar 2012-08-02, 13:01
+
Harsh J 2012-08-02, 17:48
+
Alok Kumar 2012-08-03, 07:26
+
Harsh J 2012-08-03, 07:30