Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 51 to 60 from 76 (0.182s).
Loading phrases to help you
refine your search...
[expand - 2 more] - Re: New to hadoop, trying to write a customary file split - MapReduce - [mail # user]
...You are correct = they got refactored int readFromCurrentBuffer  On Mon, Jul 18, 2011 at 11:47 AM, Erik T  wrote:    Steven M. Lewis PhD 4221 105th Ave NE Kirkland, WA 98...
   Author: Steve Lewis, 2011-07-18, 20:32
Re: security policy rules to reduce tasks? - MapReduce - [mail # user]
...Why not install a Security Manager in the reducer's setup step?   On Sun, Jul 10, 2011 at 10:26 PM, Pedro Sa Costa  wrote:    Steven M. Lewis PhD 4221 105th Ave NE Kirkla...
   Author: Steve Lewis, 2011-07-11, 15:19
Re: "java.lang.Throwable: Child Error " And " Task process exit with nonzero status of 1." - MapReduce - [mail # user]
...We have seen that limit reached when we ran a large number of jobs (3000 strikes me as the figure but the real number may be hire) It has to do with the number of files created in a 24 hour ...
   Author: Steve Lewis, 2011-07-11, 15:18
Is there a way to insure that different jobs have the same number of reducers - MapReduce - [mail # user]
...I am trying to run an application where I try to generate the cartesion product of two potentially large data sets. In reality I only need the cartesian product of values in the set with a p...
   Author: Steve Lewis, 2011-06-30, 01:05
[expand - 1 more] - Re: Algorithm for cross product - MapReduce - [mail # user]
...The approach you suggest is similar to what I am currently doing but it requires you to size the partitions to the memory available on the reducer. This is a non-trivial task and is not nece...
   Author: Steve Lewis, 2011-06-23, 17:07
Is there any way for the reducer to determine the total number of reduce tasks? - MapReduce - [mail # user]
...Also is there a good way in code to determine whether job is running on a cluster or in local mode.  I want certain debugging information to log only in local mode  Steven M. Lewis...
   Author: Steve Lewis, 2011-06-22, 22:12
Re: Custom input format query - MapReduce - [mail # user]
...1) add          @Override         public Text getCurrentKey() {             return key;        ...
   Author: Steve Lewis, 2011-05-20, 00:57
Re: How to create a SequenceFile more faster? - MapReduce - [mail # user]
...Even for a single machine (and there may be reasons to use a single machine if the original data is not splittable) Our experience suggests it should take about an hour to process 32 GB on a...
   Author: Steve Lewis, 2011-05-12, 15:55
Re: Passing an Object to All Reducers - MapReduce - [mail # user]
...If possible serialize the object as XML then add it as a set of lines to the config - alternatively serialize it (maybe xml) to a known spot in HDFS and read it in in the setup code in the r...
   Author: Steve Lewis, 2011-05-06, 17:55
Re: Creating custom input split.l - MapReduce - [mail # user]
...This is a custom splitter for extracting XML Tags from XML documents - to use is subclass as follows. It assumes the document is pretty printed with the start and end tags on separate lines....
   Author: Steve Lewis, 2011-04-09, 16:20
Sort:
project
MapReduce (74)
Hadoop (38)
Spark (24)
HDFS (5)
type
mail # user (76)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (76)
author
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (308)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (166)
Jason Lowe (163)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (80)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
Steve Lewis