Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: hadoop cluster not working


Copy link to this message
-
Re: hadoop cluster not working
mallik arjun 2013-03-12, 18:15
finally my cluster is running well see the following things

Warning: $HADOOP_HOME is deprecated.

mallik@ubuntu:~$ sudo nano /etc/sysctl.conf
mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar
input  outputmap
Warning: $HADOOP_HOME is deprecated.

mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$ hadoop dfsadmin -safemode get
Warning: $HADOOP_HOME is deprecated.

Safe mode is ON
mallik@ubuntu:~$ hadoop dfsadmin -safemode leave
Warning: $HADOOP_HOME is deprecated.

Safe mode is OFF
mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$
mallik@ubuntu:~$
mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar
input  outputmap
Warning: $HADOOP_HOME is deprecated.

13/03/12 23:44:38 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
13/03/12 23:44:38 INFO input.FileInputFormat: Total input paths to process
: 1
13/03/12 23:44:38 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
13/03/12 23:44:38 WARN snappy.LoadSnappy: Snappy native library not loaded
13/03/12 23:44:39 INFO mapred.JobClient: Running job: job_201303122326_0001
13/03/12 23:44:40 INFO mapred.JobClient:  map 0% reduce 0%
13/03/12 23:44:55 INFO mapred.JobClient:  map 100% reduce 0%
13/03/12 23:45:10 INFO mapred.JobClient:  map 100% reduce 100%
13/03/12 23:45:15 INFO mapred.JobClient: Job complete: job_201303122326_0001
13/03/12 23:45:15 INFO mapred.JobClient: Counters: 29
13/03/12 23:45:15 INFO mapred.JobClient:   Job Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Launched reduce tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=15198
13/03/12 23:45:15 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
13/03/12 23:45:15 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
13/03/12 23:45:15 INFO mapred.JobClient:     Launched map tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     Data-local map tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=14400
13/03/12 23:45:15 INFO mapred.JobClient:   File Output Format Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Bytes Written=17
13/03/12 23:45:15 INFO mapred.JobClient:   FileSystemCounters
13/03/12 23:45:15 INFO mapred.JobClient:     FILE_BYTES_READ=61
13/03/12 23:45:15 INFO mapred.JobClient:     HDFS_BYTES_READ=634
13/03/12 23:45:15 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=42869
13/03/12 23:45:15 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=17
13/03/12 23:45:15 INFO mapred.JobClient:   File Input Format Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Bytes Read=529
13/03/12 23:45:15 INFO mapred.JobClient:   Map-Reduce Framework
13/03/12 23:45:15 INFO mapred.JobClient:     Map output materialized
bytes=61
13/03/12 23:45:15 INFO mapred.JobClient:     Map input records=5
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce shuffle bytes=61
13/03/12 23:45:15 INFO mapred.JobClient:     Spilled Records=10
13/03/12 23:45:15 INFO mapred.JobClient:     Map output bytes=45
13/03/12 23:45:15 INFO mapred.JobClient:     Total committed heap usage
(bytes)=204341248
13/03/12 23:45:15 INFO mapred.JobClient:     CPU time spent (ms)=4210
13/03/12 23:45:15 INFO mapred.JobClient:     Combine input records=0
13/03/12 23:45:15 INFO mapred.JobClient:     SPLIT_RAW_BYTES=105
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce input records=5
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce input groups=2
13/03/12 23:45:15 INFO mapred.JobClient:     Combine output records=0
13/03/12 23:45:15 INFO mapred.JobClient:     Physical memory (bytes)
snapshot=275357696
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce output records=2
13/03/12 23:45:15 INFO mapred.JobClient:     Virtual memory (bytes)
snapshot=2928607232
13/03/12 23:45:15 INFO mapred.JobClient:     Map output records=5

On Tue, Mar 12, 2013 at 10:57 PM, mallik arjun <[EMAIL PROTECTED]>wrote: