Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Re: About running a simple wordcount mapreduce


Copy link to this message
-
Re: About running a simple wordcount mapreduce
Which version of Hadoop are you using. A quick search shows me a bug
https://issues.apache.org/jira/browse/HADOOP-5241 that seems to show
similar symptoms. However, that was fixed a long while ago.
On Sat, Mar 23, 2013 at 4:40 PM, Redwane belmaati cherkaoui <
[EMAIL PROTECTED]> wrote:

> This the content of the jobtracker log file :
> 2013-03-23 12:06:48,912 INFO org.apache.hadoop.mapred.JobInProgress: Input
> size for job job_201303231139_0001 = 6950001. Number of splits = 7
> 2013-03-23 12:06:48,925 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000000 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,927 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000001 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,930 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000002 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,931 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000003 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,933 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000004 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,934 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000005 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,939 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000006 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,950 INFO org.apache.hadoop.mapred.JobInProgress:
> job_201303231139_0001 LOCALITY_WAIT_FACTOR=0.5
> 2013-03-23 12:06:48,978 INFO org.apache.hadoop.mapred.JobInProgress: Job
> job_201303231139_0001 initialized successfully with 7 map tasks and 1
> reduce tasks.
> 2013-03-23 12:06:50,855 INFO org.apache.hadoop.mapred.JobTracker: Adding
> task (JOB_SETUP) 'attempt_201303231139_0001_m_000008_0' to tip
> task_201303231139_0001_m_000008, for tracker
> 'tracker_hadoop0.novalocal:hadoop0.novalocal/127.0.0.1:44879'
> 2013-03-23 12:08:00,340 INFO org.apache.hadoop.mapred.JobInProgress: Task
> 'attempt_201303231139_0001_m_000008_0' has completed
> task_201303231139_0001_m_000008 successfully.
> 2013-03-23 12:08:00,538 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,543 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,544 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,544 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:01,264 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop1.novalocal has 8807518208 bytes free; but we
> expect map to take 1317624576693539401
>
>
> The value in we excpect map to take is too huge   1317624576693539401
> bytes  !!!!!!!
>
> On Sat, Mar 23, 2013 at 11:37 AM, Redwane belmaati cherkaoui <
> [EMAIL PROTECTED]> wrote:
>
>> The estimated value that the hadoop compute is too huge for the simple
>> example that i am running .
>>
>> ---------- Forwarded message ----------
>> From: Redwane belmaati cherkaoui <[EMAIL PROTECTED]>
>>  Date: Sat, Mar 23, 2013 at 11:32 AM
>> Subject: Re: About running a simple wordcount mapreduce
>> To: Abdelrahman Shettia <[EMAIL PROTECTED]>
>> Cc: [EMAIL PROTECTED], reduno1985 <[EMAIL PROTECTED]>
>>
>>
>> This the output that I get I am running two machines  as you can see  do
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB