Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 41 to 50 from 84 (0.058s).
Loading phrases to help you
refine your search...
Re: Input splits for sequence file input - Hadoop - [mail # user]
...This question is fundamentally flawed : it assumes that a mapper will ask for anything.  The mapper class "run" method reads from a record reader.  The question you really should a...
   Author: Jay Vyas, 2012-12-03, 05:52
Other file systems for hadoop - Hadoop - [mail # user]
...what are the minimal requirements to implement the filesystem interface for hdfs?  I was thinking it might be cool to directly implement a 100% memory filesystem, just for the hell of i...
   Author: Jay Vyas, 2012-10-30, 15:46
Broad question on sorting of mapper outputs. - Hadoop - [mail # user]
...IS there any documentation on the internals of the shuffle and sort phase? The elephant book seems to be the best source, but it appears to only lightly touch upon the "magic" part (i.e. the...
   Author: Jay Vyas, 2012-10-20, 03:19
33%, 66%, and 100% *reducer* optimization - Hadoop - [mail # user]
...Hi guys !  We all know that there are major milestones in reducers (33%, 66%)  In particular:  Im wondering: What should we optimize for in case a job hangs at 33%, as compare...
   Author: Jay Vyas, 2012-10-15, 21:32
Re: Suitability of HDFS for live file store - Hadoop - [mail # user]
...Seems like a heavyweight solution unless you are actually processing the images?  Wow, no mapreduce, no streaming writes, and relatively small files.  Im surprised that you are con...
   Author: Jay Vyas, 2012-10-15, 20:21
speculative execution before mappers finish - Hadoop - [mail # user]
...Is it possible for reducers to start (not just copying, but actually) "reducing" before all mappers are done, speculatively?  In particular im asking this because Im curious about the i...
   Author: Jay Vyas, 2012-10-13, 02:16
pojo writables - Hadoop - [mail # user]
...One of the benefits of using autogenerated objects for serialization, we are finding, is just the fact that there is a strong, semantically meaningful API.  This could seemingly be done...
   Author: Jay Vyas, 2012-10-08, 14:13
setJarByClass method semantics - Hadoop - [mail # user]
...Hi guys:  What does the setJarByClass method do, if for example ,a given class does not exist inside of a JAR file?  For example, in the case that we are running compiled java clas...
   Author: Jay Vyas, 2012-10-05, 22:00
Re: resetting conf/ parameters in a life cluster. - Hadoop - [mail # user]
...hmmm.... I wonder if there is a way to push conf/*xml parameters out to all the slaves, maybe at runtime ?  On Sat, Aug 18, 2012 at 4:06 PM, Harsh J  wrote:     Jay Vyas ...
   Author: Jay Vyas, 2012-08-18, 15:16
Hadoop idioms for reporting cluster and counter stats. - Hadoop - [mail # user]
...Hi guys : I want to start automating the output of  counter stats, cluster size, etc... at the end of the main map reduce jobs which we run.  Is there a simple way to do this ? &nb...
   Author: Jay Vyas, 2012-08-16, 17:07
Hadoop (79)
Bigtop (73)
MapReduce (53)
HDFS (25)
HBase (17)
Hive (10)
Pig (9)
Ambari (1)
Flume (1)
mail # user (80)
mail # dev (4)
last 7 days (4)
last 30 days (9)
last 90 days (21)
last 6 months (25)
last 9 months (84)
Harsh J (537)
Owen O'Malley (402)
Steve Loughran (357)
Todd Lipcon (234)
Eli Collins (181)
Arun C Murthy (156)
Chris Nauroth (130)
Alejandro Abdelnur (121)
Allen Wittenauer (115)
Nigel Daley (112)
Tom White (111)
Daryn Sharp (108)
Konstantin Shvachko (102)
Ted Yu (95)
Aaron Kimball (93)
Jay Vyas