Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 18 from 18 (0.091s).
Loading phrases to help you
refine your search...
Keeping Map-Tasks alive - MapReduce - [mail # user]
...Hi, Is there a way to keep a map-task alive after it has finished its work, to later perform another task on its same input? For example, consider the k-means clustering algorithm (k-means d...
   Author: Yaron Gonen, 2012-08-05, 10:47
Keeping intermediate results - MapReduce - [mail # user]
...Hi, Suppose I have chained M/R jobs that traverse a graph and look for nodes with a specific value. Every time a Map encounters that value, I'd like to keep that node in the final result. I ...
   Author: Yaron Gonen, 2011-11-06, 16:21
Re: Mapper Getting the whole split and not just line by line - MapReduce - [mail # user]
...thanks! I'll try overriding the run method first.  On Wed, Oct 12, 2011 at 3:18 PM, Harsh J  wrote:  e t rs...
   Author: Yaron Gonen, 2011-10-12, 19:14
Re: Mapper Getting the whole split and not just line by line - MapReduce - [mail # user]
...Thanks for the fast reply! I've dug in the code a little bit, and it seems to me that I can achieve my goal by overloading Mapper.run method: just iterate over the whole split by using conte...
   Author: Yaron Gonen, 2011-10-12, 11:44
Mapper Getting the whole split and not just line by line - MapReduce - [mail # user]
...Hi, The map method in the Mapper gets as a parameter a single line from the split. Is there a way for Mappers to get the whole split as input? I'd like to scan the whole split before I decid...
   Author: Yaron Gonen, 2011-10-12, 09:12
Re: Submitting a Hadoop task from withing a reducer - MapReduce - [mail # user]
...Thanks guys. I'll dig a little in Yarn.  On Tue, Oct 4, 2011 at 6:28 PM, Joey Echeverria  wrote:  ...
   Author: Yaron Gonen, 2011-10-05, 13:50
Submitting a Hadoop task from withing a reducer - MapReduce - [mail # user]
...Hi, Hadoop tasks are always stacked to form a linear user-managed workflow (a reduce step cannot start before all previous mappers have stopped etc). This may be problematic in recursive tas...
   Author: Yaron Gonen, 2011-10-04, 15:45
Re: How to pass a parameter across the cluster. - MapReduce - [mail # user]
...There is no "right way". I think the best thing to do is to ask in the forums. I thought maybe via the Configuration object, but this is by no way a formal solution.   On Wed, Sep 7, 20...
   Author: Yaron Gonen, 2011-09-07, 12:11
Sort:
project
MapReduce (18)
HDFS (10)
Hadoop (1)
type
mail # user (18)
date
last 7 days (0)
last 30 days (0)
last 90 days (1)
last 6 months (5)
last 9 months (18)
author
Harsh J (1067)
Arun C Murthy (524)
Vinod Kumar Vavilapalli (353)
Todd Lipcon (283)
Amar Kamat (184)
Mohammad Tariq (177)
Thomas Graves (176)
Owen O'Malley (162)
Hemanth Yamijala (155)
Amareshwari Sriramadasu (153)
Pedro Costa (153)
Robert Evans (149)
Ted Yu (148)
Tom White (138)
Alejandro Abdelnur (137)
Yaron Gonen