Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 41 to 50 from 81 (0.285s).
Loading phrases to help you
refine your search...
33%, 66%, and 100% *reducer* optimization - Hadoop - [mail # user]
...Hi guys !  We all know that there are major milestones in reducers (33%, 66%)  In particular:  Im wondering: What should we optimize for in case a job hangs at 33%, as compare...
   Author: Jay Vyas, 2012-10-15, 21:32
Re: Suitability of HDFS for live file store - Hadoop - [mail # user]
...Seems like a heavyweight solution unless you are actually processing the images?  Wow, no mapreduce, no streaming writes, and relatively small files.  Im surprised that you are con...
   Author: Jay Vyas, 2012-10-15, 20:21
speculative execution before mappers finish - Hadoop - [mail # user]
...Is it possible for reducers to start (not just copying, but actually) "reducing" before all mappers are done, speculatively?  In particular im asking this because Im curious about the i...
   Author: Jay Vyas, 2012-10-13, 02:16
pojo writables - Hadoop - [mail # user]
...One of the benefits of using autogenerated objects for serialization, we are finding, is just the fact that there is a strong, semantically meaningful API.  This could seemingly be done...
   Author: Jay Vyas, 2012-10-08, 14:13
setJarByClass method semantics - Hadoop - [mail # user]
...Hi guys:  What does the setJarByClass method do, if for example ,a given class does not exist inside of a JAR file?  For example, in the case that we are running compiled java clas...
   Author: Jay Vyas, 2012-10-05, 22:00
Re: resetting conf/ parameters in a life cluster. - Hadoop - [mail # user]
...hmmm.... I wonder if there is a way to push conf/*xml parameters out to all the slaves, maybe at runtime ?  On Sat, Aug 18, 2012 at 4:06 PM, Harsh J  wrote:     Jay Vyas ...
   Author: Jay Vyas, 2012-08-18, 15:16
Hadoop idioms for reporting cluster and counter stats. - Hadoop - [mail # user]
...Hi guys : I want to start automating the output of  counter stats, cluster size, etc... at the end of the main map reduce jobs which we run.  Is there a simple way to do this ? &nb...
   Author: Jay Vyas, 2012-08-16, 17:07
Re: Mechanism of hadoop -jar - Hadoop - [mail # user]
...Sorry for the confusion... To be clear It is TOTALLY okay to jar up a text file and access it in hadoop via the class.getResource(...) api !  1) Hadoop doesn't do anything funny with th...
   Author: Jay Vyas, 2012-08-12, 02:09
Re: Merge Reducers Output - Hadoop - [mail # user]
...Its not clear to me that you need custom input formats....  1) Getmerge might work or  2) Simply run a SINGLE reducer job (have mappers output static final int key=1, or specify nu...
   Author: Jay Vyas, 2012-07-31, 05:08
EMR classpath overiding over all mappers/reducers - Hadoop - [mail # user]
...HI guys :  I have an EMR job which seems to be loading "old" versions of an aws-sdk-java jar.  I looked closer and found that the hadoop nodes im using in fact have a old version o...
   Author: Jay Vyas, 2012-07-27, 04:07
Sort:
project
Hadoop (76)
Bigtop (72)
MapReduce (53)
HDFS (25)
HBase (17)
Hive (10)
Pig (9)
Ambari (1)
Flume (1)
type
mail # user (78)
mail # dev (3)
date
last 7 days (1)
last 30 days (7)
last 90 days (19)
last 6 months (22)
last 9 months (81)
author
Harsh J (537)
Owen O'Malley (402)
Steve Loughran (356)
Todd Lipcon (234)
Eli Collins (181)
Arun C Murthy (157)
Chris Nauroth (129)
Alejandro Abdelnur (121)
Allen Wittenauer (115)
Nigel Daley (112)
Tom White (110)
Daryn Sharp (108)
Konstantin Shvachko (102)
Aaron Kimball (93)
Ted Yu (93)
Jay Vyas