Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Re: Hadoop Tutorial help


Copy link to this message
-
Re: Hadoop Tutorial help
also, my tasktracker.log states that the task tracker was not created at
all.

2012-12-11 14:57:47,118 ERROR org.apache.hadoop.mapred.TaskTracker: Can not
start task tracker because java.io.IOException: Failed to set permissions
of path: \tmp\hadoop-XXXXX\mapred\local\taskTracker to 0755
i tried setting the permissions to this folder exclusively by chmod or
so... but that never works....

I am currently using hadoop-1.1.1 version and after some googling, i
found out that moving to other releases is alternate solution. Is that so?
On Tue, Dec 11, 2012 at 1:01 PM, Jennifer Lopez <[EMAIL PROTECTED]>wrote:

> i have installed hadoop on my windows 7 using cygwin. We are doing this
> mainly to prepare a POC on using hadoop with Big Data. Nothing more than
> that.
>
> But, as I read from the documentation, "the native hadoop library is
> supported on *nix platforms only. The library does not to work with Cygwin<http://www.cygwin.com/>or the Mac
> OS X <http://www.apple.com/macosx> platform."
>
> so, does that mean all the doors are closed for me?
>
>
> On Tue, Dec 11, 2012 at 12:50 PM, Jain Rahul <[EMAIL PROTECTED]>wrote:
>
>>  It is not an issue. It Simply means that it is not able to load
>> native-Hadoop library for compression, as not available in class-path so it
>> is using built-in java classes.
>>
>>
>>
>> Check the below link.
>>
>>
>>
>> http://hadoop.apache.org/docs/r1.0.4/native_libraries.html
>>
>>
>>
>> Regards,
>>
>> Rahul
>>
>>
>>
>> *From:* Jennifer Lopez [mailto:[EMAIL PROTECTED]]
>> *Sent:* 11 December 2012 12:25
>> *To:* Jain Rahul
>>
>> *Subject:* Re: Hadoop Tutorial help
>>
>>
>>
>> Hey Rahu/Nitin,
>>
>>
>>
>> Those links are very helpful. I have now downloaded hadoop 1.1.1.
>> version. The setup went smooth so far. I, now get this error. Any clue?
>>
>>
>>
>> 12/12/11 12:20:50 WARN util.NativeCodeLoader: Unable to load
>> native-hadoop library for your platform... using builtin-java classes where
>> applicable
>>
>> 12/12/11 12:20:50 WARN snappy.LoadSnappy: Snappy native library not loaded
>>
>> 12/12/11 12:20:50 INFO mapred.FileInputFormat: Total input paths to
>> process : 16
>>
>> 12/12/11 12:20:50 INFO mapred.JobClient: Running job:
>> job_201212111147_0004
>>
>> 12/12/11 12:20:51 INFO mapred.JobClient: map 0% reduce 0%
>>
>>
>>
>>
>>
>>
>>
>> Regards,
>>
>> Jenny
>>
>> On Mon, Dec 10, 2012 at 12:41 PM, Jain Rahul <[EMAIL PROTECTED]>
>> wrote:
>>
>> You can also check these two links.
>>
>>
>>
>>
>> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
>>
>>
>>
>>
>> http://www.thegeekstuff.com/2012/02/hadoop-pseudo-distributed-installation/
>>
>>
>>
>>
>>
>> Regards,
>>
>> Rahul
>>
>>
>>
>> *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]]
>> *Sent:* 10 December 2012 12:37
>> *To:* [EMAIL PROTECTED]
>> *Subject:* Re: Hadoop Tutorial help
>>
>>
>>
>> You will need to move to minimum version of hadoop @0.20.2 or 1.0.2
>>
>>
>>
>> 0.18 is long retired.
>>
>>
>>
>> You can just setup a plain linux VM and setup a single node hadoop using
>> the tutorial. Most of the things would remain same but should be straight
>> forward to solve through. You also dont need to compile hadoop, you can
>> just download pre-build hadoop binaries from apache
>>
>>
>>
>> On Sun, Dec 9, 2012 at 9:23 PM, Jennifer Lopez <[EMAIL PROTECTED]>
>> wrote:
>>
>> I am going through the tutorial presented @
>> http://developer.yahoo.com/hadoop/tutorial/module3.html#vm-jobs
>>
>> I have installed vmware and hadoop virtual machine. This tutorial talks
>> about hadoop 0.18.0 version and states that the compilation would be done
>> in the windows host machine.  I want to try out simple examples.
>>
>> And now I see that this hadoop 0.18.0 version is not availble @ apache
>> hadoop website.
>>
>> How do I go ahead now? Are any other Hadoop virtual machines available
>> for such tutorials?
>> Any info would be highly appreciated.
>>
>> -- Lopez
>>
>>
>>
>>
>>
>> --
>> Nitin Pawar
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB