|
|
-
Re: hadoop cluster not workingmallik arjun 2013-03-12, 18:15
finally my cluster is running well see the following things
Warning: $HADOOP_HOME is deprecated. mallik@ubuntu:~$ sudo nano /etc/sysctl.conf mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar input outputmap Warning: $HADOOP_HOME is deprecated. mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6 1 mallik@ubuntu:~$ hadoop dfsadmin -safemode get Warning: $HADOOP_HOME is deprecated. Safe mode is ON mallik@ubuntu:~$ hadoop dfsadmin -safemode leave Warning: $HADOOP_HOME is deprecated. Safe mode is OFF mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6 1 mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6 1 mallik@ubuntu:~$ mallik@ubuntu:~$ mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar input outputmap Warning: $HADOOP_HOME is deprecated. 13/03/12 23:44:38 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 13/03/12 23:44:38 INFO input.FileInputFormat: Total input paths to process : 1 13/03/12 23:44:38 INFO util.NativeCodeLoader: Loaded the native-hadoop library 13/03/12 23:44:38 WARN snappy.LoadSnappy: Snappy native library not loaded 13/03/12 23:44:39 INFO mapred.JobClient: Running job: job_201303122326_0001 13/03/12 23:44:40 INFO mapred.JobClient: map 0% reduce 0% 13/03/12 23:44:55 INFO mapred.JobClient: map 100% reduce 0% 13/03/12 23:45:10 INFO mapred.JobClient: map 100% reduce 100% 13/03/12 23:45:15 INFO mapred.JobClient: Job complete: job_201303122326_0001 13/03/12 23:45:15 INFO mapred.JobClient: Counters: 29 13/03/12 23:45:15 INFO mapred.JobClient: Job Counters 13/03/12 23:45:15 INFO mapred.JobClient: Launched reduce tasks=1 13/03/12 23:45:15 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=15198 13/03/12 23:45:15 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0 13/03/12 23:45:15 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0 13/03/12 23:45:15 INFO mapred.JobClient: Launched map tasks=1 13/03/12 23:45:15 INFO mapred.JobClient: Data-local map tasks=1 13/03/12 23:45:15 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=14400 13/03/12 23:45:15 INFO mapred.JobClient: File Output Format Counters 13/03/12 23:45:15 INFO mapred.JobClient: Bytes Written=17 13/03/12 23:45:15 INFO mapred.JobClient: FileSystemCounters 13/03/12 23:45:15 INFO mapred.JobClient: FILE_BYTES_READ=61 13/03/12 23:45:15 INFO mapred.JobClient: HDFS_BYTES_READ=634 13/03/12 23:45:15 INFO mapred.JobClient: FILE_BYTES_WRITTEN=42869 13/03/12 23:45:15 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=17 13/03/12 23:45:15 INFO mapred.JobClient: File Input Format Counters 13/03/12 23:45:15 INFO mapred.JobClient: Bytes Read=529 13/03/12 23:45:15 INFO mapred.JobClient: Map-Reduce Framework 13/03/12 23:45:15 INFO mapred.JobClient: Map output materialized bytes=61 13/03/12 23:45:15 INFO mapred.JobClient: Map input records=5 13/03/12 23:45:15 INFO mapred.JobClient: Reduce shuffle bytes=61 13/03/12 23:45:15 INFO mapred.JobClient: Spilled Records=10 13/03/12 23:45:15 INFO mapred.JobClient: Map output bytes=45 13/03/12 23:45:15 INFO mapred.JobClient: Total committed heap usage (bytes)=204341248 13/03/12 23:45:15 INFO mapred.JobClient: CPU time spent (ms)=4210 13/03/12 23:45:15 INFO mapred.JobClient: Combine input records=0 13/03/12 23:45:15 INFO mapred.JobClient: SPLIT_RAW_BYTES=105 13/03/12 23:45:15 INFO mapred.JobClient: Reduce input records=5 13/03/12 23:45:15 INFO mapred.JobClient: Reduce input groups=2 13/03/12 23:45:15 INFO mapred.JobClient: Combine output records=0 13/03/12 23:45:15 INFO mapred.JobClient: Physical memory (bytes) snapshot=275357696 13/03/12 23:45:15 INFO mapred.JobClient: Reduce output records=2 13/03/12 23:45:15 INFO mapred.JobClient: Virtual memory (bytes) snapshot=2928607232 13/03/12 23:45:15 INFO mapred.JobClient: Map output records=5 On Tue, Mar 12, 2013 at 10:57 PM, mallik arjun <[EMAIL PROTECTED]>wrote: |