|
|
-
Re: Hadoop Tutorial helpJennifer Lopez 2012-12-11, 09:31
also, my tasktracker.log states that the task tracker was not created at
all. 2012-12-11 14:57:47,118 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because java.io.IOException: Failed to set permissions of path: \tmp\hadoop-XXXXX\mapred\local\taskTracker to 0755 i tried setting the permissions to this folder exclusively by chmod or so... but that never works.... I am currently using hadoop-1.1.1 version and after some googling, i found out that moving to other releases is alternate solution. Is that so? On Tue, Dec 11, 2012 at 1:01 PM, Jennifer Lopez <[EMAIL PROTECTED]>wrote: > i have installed hadoop on my windows 7 using cygwin. We are doing this > mainly to prepare a POC on using hadoop with Big Data. Nothing more than > that. > > But, as I read from the documentation, "the native hadoop library is > supported on *nix platforms only. The library does not to work with Cygwin<http://www.cygwin.com/>or the Mac > OS X <http://www.apple.com/macosx> platform." > > so, does that mean all the doors are closed for me? > > > On Tue, Dec 11, 2012 at 12:50 PM, Jain Rahul <[EMAIL PROTECTED]>wrote: > >> It is not an issue. It Simply means that it is not able to load >> native-Hadoop library for compression, as not available in class-path so it >> is using built-in java classes. >> >> >> >> Check the below link. >> >> >> >> http://hadoop.apache.org/docs/r1.0.4/native_libraries.html >> >> >> >> Regards, >> >> Rahul >> >> >> >> *From:* Jennifer Lopez [mailto:[EMAIL PROTECTED]] >> *Sent:* 11 December 2012 12:25 >> *To:* Jain Rahul >> >> *Subject:* Re: Hadoop Tutorial help >> >> >> >> Hey Rahu/Nitin, >> >> >> >> Those links are very helpful. I have now downloaded hadoop 1.1.1. >> version. The setup went smooth so far. I, now get this error. Any clue? >> >> >> >> 12/12/11 12:20:50 WARN util.NativeCodeLoader: Unable to load >> native-hadoop library for your platform... using builtin-java classes where >> applicable >> >> 12/12/11 12:20:50 WARN snappy.LoadSnappy: Snappy native library not loaded >> >> 12/12/11 12:20:50 INFO mapred.FileInputFormat: Total input paths to >> process : 16 >> >> 12/12/11 12:20:50 INFO mapred.JobClient: Running job: >> job_201212111147_0004 >> >> 12/12/11 12:20:51 INFO mapred.JobClient: map 0% reduce 0% >> >> >> >> >> >> >> >> Regards, >> >> Jenny >> >> On Mon, Dec 10, 2012 at 12:41 PM, Jain Rahul <[EMAIL PROTECTED]> >> wrote: >> >> You can also check these two links. >> >> >> >> >> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/ >> >> >> >> >> http://www.thegeekstuff.com/2012/02/hadoop-pseudo-distributed-installation/ >> >> >> >> >> >> Regards, >> >> Rahul >> >> >> >> *From:* Nitin Pawar [mailto:[EMAIL PROTECTED]] >> *Sent:* 10 December 2012 12:37 >> *To:* [EMAIL PROTECTED] >> *Subject:* Re: Hadoop Tutorial help >> >> >> >> You will need to move to minimum version of hadoop @0.20.2 or 1.0.2 >> >> >> >> 0.18 is long retired. >> >> >> >> You can just setup a plain linux VM and setup a single node hadoop using >> the tutorial. Most of the things would remain same but should be straight >> forward to solve through. You also dont need to compile hadoop, you can >> just download pre-build hadoop binaries from apache >> >> >> >> On Sun, Dec 9, 2012 at 9:23 PM, Jennifer Lopez <[EMAIL PROTECTED]> >> wrote: >> >> I am going through the tutorial presented @ >> http://developer.yahoo.com/hadoop/tutorial/module3.html#vm-jobs >> >> I have installed vmware and hadoop virtual machine. This tutorial talks >> about hadoop 0.18.0 version and states that the compilation would be done >> in the windows host machine. I want to try out simple examples. >> >> And now I see that this hadoop 0.18.0 version is not availble @ apache >> hadoop website. >> >> How do I go ahead now? Are any other Hadoop virtual machines available >> for such tutorials? >> Any info would be highly appreciated. >> >> -- Lopez >> >> >> >> >> >> -- >> Nitin Pawar |