Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Re: hadoop cluster not working


+
feng lu 2013-03-10, 03:26
Copy link to this message
-
Re: hadoop cluster not working
finally my cluster is running well see the following things

Warning: $HADOOP_HOME is deprecated.

mallik@ubuntu:~$ sudo nano /etc/sysctl.conf
mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar
input  outputmap
Warning: $HADOOP_HOME is deprecated.

mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$ hadoop dfsadmin -safemode get
Warning: $HADOOP_HOME is deprecated.

Safe mode is ON
mallik@ubuntu:~$ hadoop dfsadmin -safemode leave
Warning: $HADOOP_HOME is deprecated.

Safe mode is OFF
mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$ cat /proc/sys/net/ipv6/conf/all/disable_ipv6
1
mallik@ubuntu:~$
mallik@ubuntu:~$
mallik@ubuntu:~$ hadoop jar /home/mallik/definite/MaxTemperature.jar
input  outputmap
Warning: $HADOOP_HOME is deprecated.

13/03/12 23:44:38 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
13/03/12 23:44:38 INFO input.FileInputFormat: Total input paths to process
: 1
13/03/12 23:44:38 INFO util.NativeCodeLoader: Loaded the native-hadoop
library
13/03/12 23:44:38 WARN snappy.LoadSnappy: Snappy native library not loaded
13/03/12 23:44:39 INFO mapred.JobClient: Running job: job_201303122326_0001
13/03/12 23:44:40 INFO mapred.JobClient:  map 0% reduce 0%
13/03/12 23:44:55 INFO mapred.JobClient:  map 100% reduce 0%
13/03/12 23:45:10 INFO mapred.JobClient:  map 100% reduce 100%
13/03/12 23:45:15 INFO mapred.JobClient: Job complete: job_201303122326_0001
13/03/12 23:45:15 INFO mapred.JobClient: Counters: 29
13/03/12 23:45:15 INFO mapred.JobClient:   Job Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Launched reduce tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=15198
13/03/12 23:45:15 INFO mapred.JobClient:     Total time spent by all
reduces waiting after reserving slots (ms)=0
13/03/12 23:45:15 INFO mapred.JobClient:     Total time spent by all maps
waiting after reserving slots (ms)=0
13/03/12 23:45:15 INFO mapred.JobClient:     Launched map tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     Data-local map tasks=1
13/03/12 23:45:15 INFO mapred.JobClient:     SLOTS_MILLIS_REDUCES=14400
13/03/12 23:45:15 INFO mapred.JobClient:   File Output Format Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Bytes Written=17
13/03/12 23:45:15 INFO mapred.JobClient:   FileSystemCounters
13/03/12 23:45:15 INFO mapred.JobClient:     FILE_BYTES_READ=61
13/03/12 23:45:15 INFO mapred.JobClient:     HDFS_BYTES_READ=634
13/03/12 23:45:15 INFO mapred.JobClient:     FILE_BYTES_WRITTEN=42869
13/03/12 23:45:15 INFO mapred.JobClient:     HDFS_BYTES_WRITTEN=17
13/03/12 23:45:15 INFO mapred.JobClient:   File Input Format Counters
13/03/12 23:45:15 INFO mapred.JobClient:     Bytes Read=529
13/03/12 23:45:15 INFO mapred.JobClient:   Map-Reduce Framework
13/03/12 23:45:15 INFO mapred.JobClient:     Map output materialized
bytes=61
13/03/12 23:45:15 INFO mapred.JobClient:     Map input records=5
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce shuffle bytes=61
13/03/12 23:45:15 INFO mapred.JobClient:     Spilled Records=10
13/03/12 23:45:15 INFO mapred.JobClient:     Map output bytes=45
13/03/12 23:45:15 INFO mapred.JobClient:     Total committed heap usage
(bytes)=204341248
13/03/12 23:45:15 INFO mapred.JobClient:     CPU time spent (ms)=4210
13/03/12 23:45:15 INFO mapred.JobClient:     Combine input records=0
13/03/12 23:45:15 INFO mapred.JobClient:     SPLIT_RAW_BYTES=105
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce input records=5
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce input groups=2
13/03/12 23:45:15 INFO mapred.JobClient:     Combine output records=0
13/03/12 23:45:15 INFO mapred.JobClient:     Physical memory (bytes)
snapshot=275357696
13/03/12 23:45:15 INFO mapred.JobClient:     Reduce output records=2
13/03/12 23:45:15 INFO mapred.JobClient:     Virtual memory (bytes)
snapshot=2928607232
13/03/12 23:45:15 INFO mapred.JobClient:     Map output records=5

On Tue, Mar 12, 2013 at 10:57 PM, mallik arjun <[EMAIL PROTECTED]>wrote:

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB