Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: About running a simple wordcount mapreduce


Copy link to this message
-
Re: About running a simple wordcount mapreduce
Hemanth Yamijala 2013-03-25, 06:11
Which version of Hadoop are you using. A quick search shows me a bug
https://issues.apache.org/jira/browse/HADOOP-5241 that seems to show
similar symptoms. However, that was fixed a long while ago.
On Sat, Mar 23, 2013 at 4:40 PM, Redwane belmaati cherkaoui <
[EMAIL PROTECTED]> wrote:

> This the content of the jobtracker log file :
> 2013-03-23 12:06:48,912 INFO org.apache.hadoop.mapred.JobInProgress: Input
> size for job job_201303231139_0001 = 6950001. Number of splits = 7
> 2013-03-23 12:06:48,925 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000000 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,927 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000001 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,930 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000002 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,931 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000003 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,933 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000004 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,934 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000005 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,939 INFO org.apache.hadoop.mapred.JobInProgress:
> tip:task_201303231139_0001_m_000006 has split on
> node:/default-rack/hadoop0.novalocal
> 2013-03-23 12:06:48,950 INFO org.apache.hadoop.mapred.JobInProgress:
> job_201303231139_0001 LOCALITY_WAIT_FACTOR=0.5
> 2013-03-23 12:06:48,978 INFO org.apache.hadoop.mapred.JobInProgress: Job
> job_201303231139_0001 initialized successfully with 7 map tasks and 1
> reduce tasks.
> 2013-03-23 12:06:50,855 INFO org.apache.hadoop.mapred.JobTracker: Adding
> task (JOB_SETUP) 'attempt_201303231139_0001_m_000008_0' to tip
> task_201303231139_0001_m_000008, for tracker
> 'tracker_hadoop0.novalocal:hadoop0.novalocal/127.0.0.1:44879'
> 2013-03-23 12:08:00,340 INFO org.apache.hadoop.mapred.JobInProgress: Task
> 'attempt_201303231139_0001_m_000008_0' has completed
> task_201303231139_0001_m_000008 successfully.
> 2013-03-23 12:08:00,538 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,543 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,544 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:00,544 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop0.novalocal has 8791543808 bytes free; but we
> expect map to take 1317624576693539401
> 2013-03-23 12:08:01,264 WARN org.apache.hadoop.mapred.JobInProgress: No
> room for map task. Node hadoop1.novalocal has 8807518208 bytes free; but we
> expect map to take 1317624576693539401
>
>
> The value in we excpect map to take is too huge   1317624576693539401
> bytes  !!!!!!!
>
> On Sat, Mar 23, 2013 at 11:37 AM, Redwane belmaati cherkaoui <
> [EMAIL PROTECTED]> wrote:
>
>> The estimated value that the hadoop compute is too huge for the simple
>> example that i am running .
>>
>> ---------- Forwarded message ----------
>> From: Redwane belmaati cherkaoui <[EMAIL PROTECTED]>
>>  Date: Sat, Mar 23, 2013 at 11:32 AM
>> Subject: Re: About running a simple wordcount mapreduce
>> To: Abdelrahman Shettia <[EMAIL PROTECTED]>
>> Cc: [EMAIL PROTECTED], reduno1985 <[EMAIL PROTECTED]>
>>
>>
>> This the output that I get I am running two machines  as you can see  do