Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Task failure in slave node


Copy link to this message
-
Re: Task failure in slave node
sorry for typo,

mahout, not mahou.  sent from mobile
On Jul 11, 2013 9:40 PM, "Azuryy Yu" <[EMAIL PROTECTED]> wrote:

> hi,
>
> put all mahou jars under hadoop_home/lib, then restart cluster.
>  On Jul 11, 2013 8:45 PM, "Margusja" <[EMAIL PROTECTED]> wrote:
>
>> Hi
>>
>> I have tow nodes:
>> n1 (master, salve) and n2 (slave)
>>
>> after set up I ran wordcount example and it worked fine:
>> [hduser@n1 ~]$ hadoop jar /usr/local/hadoop/hadoop-**examples-1.0.4.jar
>> wordcount /user/hduser/gutenberg /user/hduser/gutenberg-output
>> 13/07/11 15:30:44 INFO input.FileInputFormat: Total input paths to
>> process : 7
>> 13/07/11 15:30:44 INFO util.NativeCodeLoader: Loaded the native-hadoop
>> library
>> 13/07/11 15:30:44 WARN snappy.LoadSnappy: Snappy native library not loaded
>> 13/07/11 15:30:44 INFO mapred.JobClient: Running job:
>> job_201307111355_0015
>> 13/07/11 15:30:45 INFO mapred.JobClient:  map 0% reduce 0%
>> 13/07/11 15:31:03 INFO mapred.JobClient:  map 42% reduce 0%
>> 13/07/11 15:31:06 INFO mapred.JobClient:  map 57% reduce 0%
>> 13/07/11 15:31:09 INFO mapred.JobClient:  map 71% reduce 0%
>> 13/07/11 15:31:15 INFO mapred.JobClient:  map 100% reduce 0%
>> 13/07/11 15:31:18 INFO mapred.JobClient:  map 100% reduce 23%
>> 13/07/11 15:31:27 INFO mapred.JobClient:  map 100% reduce 100%
>> 13/07/11 15:31:32 INFO mapred.JobClient: Job complete:
>> job_201307111355_0015
>> 13/07/11 15:31:32 INFO mapred.JobClient: Counters: 30
>> 13/07/11 15:31:32 INFO mapred.JobClient:   Job Counters
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Launched reduce tasks=1
>> 13/07/11 15:31:32 INFO mapred.JobClient:     SLOTS_MILLIS_MAPS=67576
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Total time spent by all
>> reduces waiting after reserving slots (ms)=0
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Total time spent by all maps
>> waiting after reserving slots (ms)=0
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Rack-local map tasks=3
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Launched map tasks=7
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Data-local map tasks=4
>> 13/07/11 15:31:32 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=21992
>> 13/07/11 15:31:32 INFO mapred.JobClient:   File Output Format Counters
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Bytes Written=1412505
>> 13/07/11 15:31:32 INFO mapred.JobClient:   FileSystemCounters
>> 13/07/11 15:31:32 INFO mapred.JobClient:     FILE_BYTES_READ=5414195
>> 13/07/11 15:31:32 INFO mapred.JobClient:     HDFS_BYTES_READ=6950820
>> 13/07/11 15:31:32 INFO mapred.JobClient: FILE_BYTES_WRITTEN=8744993
>> 13/07/11 15:31:32 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=1412505
>> 13/07/11 15:31:32 INFO mapred.JobClient:   File Input Format Counters
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Bytes Read=6950001
>> 13/07/11 15:31:32 INFO mapred.JobClient:   Map-Reduce Framework
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Map output materialized
>> bytes=3157469
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Map input records=137146
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Reduce shuffle bytes=2904836
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Spilled Records=594764
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Map output bytes=11435849
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Total committed heap usage
>> (bytes)=1128136704
>> 13/07/11 15:31:32 INFO mapred.JobClient:     CPU time spent (ms)=18230
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Combine input records=1174991
>> 13/07/11 15:31:32 INFO mapred.JobClient:     SPLIT_RAW_BYTES=819
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Reduce input records=218990
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Reduce input groups=128513
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Combine output records=218990
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Physical memory (bytes)
>> snapshot=1179656192
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Reduce output records=128513
>> 13/07/11 15:31:32 INFO mapred.JobClient:     Virtual memory (bytes)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB