Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 13 (0.089s).
Loading phrases to help you
refine your search...
Re: Eclipse-Plugin - Hadoop - [mail # user]
...Maybe you can install the Amazon AWS SDK, and then run EMR jobs, I thinkthese can be submitted via Eclipse but I haven't tried it myself.Regards, Dieter2014-04-06 20:44 GMT+02:00 João Paulo ...
   Author: Dieter De Witte, 2014-04-06, 18:51
Re: when it's safe to read map-reduce result? - Hadoop - [mail # user]
..._SUCCES implies that the job has succesfully terminated, so this seems likea reasonable criterion.Regards, Dieter2014-03-28 9:33 GMT+01:00 Li Li : ...
   Author: Dieter De Witte, 2014-03-28, 08:36
Re: Maps stuck on Pending - Hadoop - [mail # user]
...There's is a big chance that your map output is being copied to yourreducer, this could take quite some time if you have a lot of data andcould be resolved by:1) having more reducers2) adjus...
   Author: Dieter De Witte, 2014-03-28, 07:53
Re: Job froze for hours because of an unresponsive disk on one of the task trackers - Hadoop - [mail # user]
...The ids of the tasks are different so the node got killed after failing on3 different(!) reduce tasks. The reduce task 48 will probably have beenresubmitted to another node.2014-03-27 10:22 ...
   Author: Dieter De Witte, 2014-03-27, 09:33
Re: Use Cases for Structured Data - Hadoop - [mail # user]
...Sandbox is just meant to be a learning environment i guess, to see what'spossible, how things can be connected. The real distribution will have muchhigher performance and is the one you need...
   Author: Dieter De Witte, 2014-03-13, 09:56
Re: Logic of isSplittable() of class FileInputFormat - Hadoop - [mail # user]
...if you have a simple one line record format you should allow files to besplitted, since your simulations will be better balanced.2014-02-26 11:31 GMT+01:00 Sugandha Naolekar : ...
   Author: Dieter De Witte, 2014-02-26, 11:05
Re: Mappers vs. Map tasks - Hadoop - [mail # user]
...Each node has a tasktracker with a number of map slots. A map slot hosts asmapper. A mapper executes map tasks. If there are more map tasks than slotsobviously there will be multiple rounds ...
   Author: Dieter De Witte, 2014-02-25, 07:50
Re: Performance - Hadoop - [mail # user]
...Hi,The terasort benchmark is probably the most common. It has mappers andreducers doing 'nothing', this way you only use the framework's mergesortfunctionalities.Regards, Dieter2014-02-24 16...
   Author: Dieter De Witte, 2014-02-24, 15:56
Re: heap space error - Hadoop - [mail # user]
...No problem, it's not easy to learn about all hadoop's configurationoptions. Definitely consider looking into the reference (Tom White)2014-02-24 11:20 GMT+01:00 Raj hadoop : ...
   Author: Dieter De Witte, 2014-02-24, 10:36
Re: is mapreduce.task.io.sort.mb control both map merge buffer and reduce merge buffer? - Hadoop - [mail # user]
...this parameter is the size of a spill on the map side, each time the spill is full it is sorted and written to disk. On the reduce side there is also a range of parameters. I am not sure why...
   Author: Dieter De Witte, 2013-12-12, 04:57
Sort:
project
Hadoop (12)
MapReduce (8)
type
mail # user (12)
issue (1)
date
last 7 days (0)
last 30 days (4)
last 90 days (9)
last 6 months (12)
last 9 months (13)
author
Harsh J (537)
Owen O'Malley (402)
Steve Loughran (357)
Todd Lipcon (234)
Eli Collins (181)
Arun C Murthy (157)
Chris Nauroth (129)
Alejandro Abdelnur (121)
Allen Wittenauer (115)
Nigel Daley (112)
Tom White (111)
Daryn Sharp (108)
Konstantin Shvachko (102)
Ted Yu (95)
Aaron Kimball (93)
Dieter De Witte