Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 68 (0.129s).
Loading phrases to help you
refine your search...
RE: How to make AM terminate if client crashes? - MapReduce - [mail # user]
...In our application the "client" is actually one step of many in an application.  If the "client" goes away entirely, that means the entire application has crashed or has been terminated...
   Author: John Lilley, 2014-01-17, 14:19
[expand - 5 more] - RE: temporary file locations for YARN applications - MapReduce - [mail # user]
...By the way, it seems that this ended up being a hard-coded environment variable name "LOCAL_DIRS" instead of ApplicationConstants.LOCAL_DIR_ENV, which we can't see defined anywhere. John &nb...
   Author: John Lilley, 2014-01-14, 21:30
RE: FileSystem iterative or limited alternative to listStatus() - MapReduce - [mail # user]
...Hmmm, that's not right either, but this looks like the following will work since I can stop iterating at any time. RemoteIterator listFiles(Path f, boolean recursive); Thanks for getting me ...
   Author: John Lilley, 2014-01-13, 00:37
RE: manipulating key in combine phase - MapReduce - [mail # user]
...Isn't this is what you'd normally do in the Mapper? My understanding of the combiner is that it is like a "mapper-side pre-reducer" and operates on blocks of data that have already been sort...
   Author: John Lilley, 2014-01-13, 00:28
HDFS short-circuit reads - MapReduce - [mail # user]
...Our YARN application would benefit from maximal bandwidth on HDFS reads. But I'm unclear on how short-circuit reads are enabled. Are they on by default? Can our application check programmati...
   Author: John Lilley, 2013-12-17, 00:21
RE: In YARN, how does a task tracker knows the address of a job tracker? - MapReduce - [mail # user]
...MapReduce also communicates outside of what is directly supported by YARN. In a YARN application, there is very little direct communication between the client and the AM, and between the AM ...
   Author: John Lilley, 2013-11-21, 20:27
$VARIABLE and `command` in YARN command lines - MapReduce - [mail # user]
...We've found that using either $VARIABLE Or `command` As part of a YARN command-line doesn't really work, because those two things are replaced in the application master context.  Is the...
   Author: John Lilley, 2013-11-21, 18:18
RE: Writing an application based on YARN 2.2 - MapReduce - [mail # user]
...The distributed shell example is the best one that I know of. John   From: Bill Q [mailto:[EMAIL PROTECTED]] Sent: Tuesday, November 12, 2013 12:51 PM To: [EMAIL PROTECTED] Subject: Re:...
   Author: John Lilley, 2013-11-14, 18:10
Issue with CLASSPATH environment wildcard expansion and application master - MapReduce - [mail # user]
...We are trying to get the appropriate jars into our AMs CLASSPATH, but running into an issue.  We are building on the distributed shell sample code.  Feel free to direct me to "the ...
   Author: John Lilley, 2013-11-13, 17:00
FSDataInputStream: setReadAhead, setDropBehind - MapReduce - [mail # user]
...I'm assuming that these methods exist to improve performance of certain I/O patterns, but the API doc doesn't explain when one would use them.  Our software's I/O pattern is mostly sequ...
   Author: John Lilley, 2013-11-13, 14:22
MapReduce (59)
Hadoop (26)
HDFS (17)
Avro (1)
HBase (1)
mail # user (67)
mail # dev (1)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (68)
Harsh J (454)
Arun C Murthy (326)
Vinod Kumar Vavilapalli (308)
Todd Lipcon (223)
Amar Kamat (181)
Thomas Graves (166)
Jason Lowe (163)
Amareshwari Sriramadasu (152)
Sandy Ryza (124)
Tom White (111)
Siddharth Seth (109)
Aaron Kimball (107)
Owen O'Malley (105)
Alejandro Abdelnur (103)
Devaraj K (103)
Ramya Sunil (103)
Robert Joseph Evans (101)
Hemanth Yamijala (97)
Steve Loughran (90)
Ted Yu (80)
Eli Collins (77)
Ravi Gummadi (76)
Karthik Kambatla (71)
Mahadev konar (67)
Ravi Prakash (66)
John Lilley