Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 21 to 30 from 68 (0.061s).
Loading phrases to help you
refine your search...
Re: Unblacklist a blacklisted tracker (at job level)? - MapReduce - [mail # user]
...Thanks, but it doesn't.  According to the link, restarting the task  tracker should take the node off the blacklist.  That didn't happen.  I  restarted the task trac...
   Author: David Rosenstrauch, 2011-09-15, 16:02
Re: How to Create an effective chained MapReduce program. - MapReduce - [mail # user]
...* open a SequenceFile.Reader on the sequence file * in a loop, call next(key,val) on the reader to read the next key/val  pair in the file (see:  http://hadoop.apache.org/common/do...
   Author: David Rosenstrauch, 2011-09-07, 22:17
Re: Problem when using MultipleOutputs with many files - MapReduce - [mail # user]
...On 09/02/2011 09:14 AM, Panagiotis Antonopoulos wrote:   You're probably running into this bug, which crushes the performance of  MultipleOutputs:  https://issues.apache.org/j...
   Author: David Rosenstrauch, 2011-09-02, 15:09
Re: Deep Magic on the distributed classpath - MapReduce - [mail # user]
...On 07/27/2011 10:39 AM, John Armstrong wrote:  There is another, easier approach:  if your app inherits from the Tool  class / runs via ToolRunner, then your app can inherit t...
   Author: David Rosenstrauch, 2011-07-27, 14:58
Re: Merge Reducers Outputs - MapReduce - [mail # user]
...On 07/26/2011 06:52 PM, Mohamed Riadh Trad wrote:  Not within the map-reduce job, but you can merge it after the job is  done.  At my previous company we used FileUtil.copyMer...
   Author: David Rosenstrauch, 2011-07-27, 14:55
Re: Example on how to decompress the output file? - MapReduce - [mail # user]
...On 07/05/2011 11:24 AM, Pedro Sa Costa wrote:  Write a Java app which read from an input stream (until EOF), where the  input stream is like so:  FileSystem fs = FileSystem.ge...
   Author: David Rosenstrauch, 2011-07-05, 15:34
Re: How does a ReduceTask determine which MapTask output to read? - MapReduce - [mail # user]
...On 06/29/2011 05:28 PM, Virajith Jalaparti wrote:  You're missing 2 key steps in here.  After the mappers, a sort step gets  run (to sort the records in key order) and then a ...
   Author: David Rosenstrauch, 2011-06-29, 22:37
Re: How to select random n records using mapreduce ? - MapReduce - [mail # user]
...Building on this, you could do something like the following to make it  more random:  if (numRecordsWritten < NUM_RECORDS_DESIRED) { int n = generateARandomNumberBetween1and100...
   Author: David Rosenstrauch, 2011-06-27, 20:35
Re: controlling no. of mapper tasks - MapReduce - [mail # user]
...Yes, that is correct.  It is indeed looking at the data size.  Please  carefully read through again what I wrote - particularly the part about  files getting broken into ...
   Author: David Rosenstrauch, 2011-06-20, 19:47
Re: Passing an Object to All Reducers - MapReduce - [mail # user]
...On 05/06/2011 01:12 PM, Geoffry Roberts wrote:  Serialize it to a string, set it as a configuration setting on the job's  configuration, then have each reducer read it from out of ...
   Author: David Rosenstrauch, 2011-05-06, 17:56
MapReduce (66)
Hadoop (31)
Avro (12)
HDFS (11)
Zookeeper (4)
mail # user (63)
issue (5)
last 7 days (1)
last 30 days (1)
last 90 days (1)
last 6 months (1)
last 9 months (68)
Harsh J (454)
Arun C Murthy (325)
Vinod Kumar Vavilapalli (307)
Todd Lipcon (197)
Amar Kamat (181)
Thomas Graves (164)
Amareshwari Sriramadasu (153)
Jason Lowe (150)
Owen O'Malley (126)
Sandy Ryza (123)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Ramya Sunil (103)
Devaraj K (102)
David Rosenstrauch