Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 51 to 60 from 92 (0.081s).
Loading phrases to help you
refine your search...
Broad question on sorting of mapper outputs. - Hadoop - [mail # user]
...IS there any documentation on the internals of the shuffle and sort phase? The elephant book seems to be the best source, but it appears to only lightly touch upon the "magic" part (i.e. the...
   Author: Jay Vyas, 2012-10-20, 03:19
33%, 66%, and 100% *reducer* optimization - Hadoop - [mail # user]
...Hi guys !  We all know that there are major milestones in reducers (33%, 66%)  In particular:  Im wondering: What should we optimize for in case a job hangs at 33%, as compare...
   Author: Jay Vyas, 2012-10-15, 21:32
Re: Suitability of HDFS for live file store - Hadoop - [mail # user]
...Seems like a heavyweight solution unless you are actually processing the images?  Wow, no mapreduce, no streaming writes, and relatively small files.  Im surprised that you are con...
   Author: Jay Vyas, 2012-10-15, 20:21
speculative execution before mappers finish - Hadoop - [mail # user]
...Is it possible for reducers to start (not just copying, but actually) "reducing" before all mappers are done, speculatively?  In particular im asking this because Im curious about the i...
   Author: Jay Vyas, 2012-10-13, 02:16
pojo writables - Hadoop - [mail # user]
...One of the benefits of using autogenerated objects for serialization, we are finding, is just the fact that there is a strong, semantically meaningful API.  This could seemingly be done...
   Author: Jay Vyas, 2012-10-08, 14:13
setJarByClass method semantics - Hadoop - [mail # user]
...Hi guys:  What does the setJarByClass method do, if for example ,a given class does not exist inside of a JAR file?  For example, in the case that we are running compiled java clas...
   Author: Jay Vyas, 2012-10-05, 22:00
Re: resetting conf/ parameters in a life cluster. - Hadoop - [mail # user]
...hmmm.... I wonder if there is a way to push conf/*xml parameters out to all the slaves, maybe at runtime ?  On Sat, Aug 18, 2012 at 4:06 PM, Harsh J  wrote:     Jay Vyas ...
   Author: Jay Vyas, 2012-08-18, 15:16
Hadoop idioms for reporting cluster and counter stats. - Hadoop - [mail # user]
...Hi guys : I want to start automating the output of  counter stats, cluster size, etc... at the end of the main map reduce jobs which we run.  Is there a simple way to do this ? &nb...
   Author: Jay Vyas, 2012-08-16, 17:07
Re: Mechanism of hadoop -jar - Hadoop - [mail # user]
...Sorry for the confusion... To be clear It is TOTALLY okay to jar up a text file and access it in hadoop via the class.getResource(...) api !  1) Hadoop doesn't do anything funny with th...
   Author: Jay Vyas, 2012-08-12, 02:09
Re: Merge Reducers Output - Hadoop - [mail # user]
...Its not clear to me that you need custom input formats....  1) Getmerge might work or  2) Simply run a SINGLE reducer job (have mappers output static final int key=1, or specify nu...
   Author: Jay Vyas, 2012-07-31, 05:08
Hadoop (87)
Bigtop (85)
MapReduce (53)
HDFS (25)
HBase (18)
Hive (11)
Pig (11)
Flume (2)
Spark (2)
Ambari (1)
mail # user (84)
mail # dev (8)
last 7 days (0)
last 30 days (2)
last 90 days (7)
last 6 months (29)
last 9 months (92)
Harsh J (554)
Owen O'Malley (396)
Steve Loughran (379)
Todd Lipcon (238)
Eli Collins (181)
Alejandro Abdelnur (162)
Arun C Murthy (161)
Chris Nauroth (141)
Allen Wittenauer (124)
Tom White (118)
Nigel Daley (115)
Ted Yu (114)
Daryn Sharp (110)
Konstantin Shvachko (106)
Aaron Kimball (93)
Doug Cutting (93)
Colin Patrick McCabe (86)
Edward Capriolo (86)
Mark Kerzner (86)
jason hadoop (82)
Hairong Kuang (74)
Runping Qi (72)
Konstantin Boudnik (70)
Benoy Antony (69)
Suresh Srinivas (63)
Jay Vyas