Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 30 (0.125s).
Loading phrases to help you
refine your search...
RE: YARN log access - HDFS - [mail # user]
...Ted, Thanks for the pointer.  But when I read about the RESTful API: http://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Application_API I...
   Author: John Lilley, 2014-01-04, 17:18
LocalResource size/time limits - HDFS - [mail # user]
...Are there any limits on the total size of LocalResources that a YARN app requests?  Do the PUBLIC ones age out of cache over time?  Are there settable controls? Thanks John  ...
   Author: John Lilley, 2014-01-04, 17:02
RE: In YARN, how does a task tracker knows the address of a job tracker? - HDFS - [mail # user]
...Ricky,  What you are doing sounds familiar.  We are in the process of implementing, not exactly MapReduce, but a system that has to do many of the things that MapReduce does (find ...
   Author: John Lilley, 2013-11-23, 19:16
FSDataOutputStream ByteBuffer write - HDFS - [mail # user]
...In the Hadoop 2.1 docs, I see there is a read(ByteBuffer) call in FSDataInputStream, but I don't see a write(ByteBuffer) call documented for FSDataOutputStream.  Is there a (fast) way t...
   Author: John Lilley, 2013-10-15, 18:59
RE: How to best decide mapper output/reducer input for a huge string? - HDFS - [mail # user]
...Pavan, How large are the rows in HBase?  22 million rows is not very much but you mentioned "huge strings".  Can you tell which part of the processing is the limiting factor (read ...
   Author: John Lilley, 2013-09-21, 23:08
[expand - 1 more] - RE: How to get number of data nodes as a hadoop client - HDFS - [mail # user]
...Never mind, its in the ApplicationClientProtocol class. John   From: John Lilley [mailto:[EMAIL PROTECTED]] Sent: Thursday, September 19, 2013 6:12 PM To: [EMAIL PROTECTED] Subject: How...
   Author: John Lilley, 2013-09-21, 22:54
connection overload strategies - HDFS - [mail # user]
...If my YARN application tasks are all reading/writing HDFS simultaneously and some node is unable to honor a connection request because it is overloaded, what happens?  I've seen HDFS at...
   Author: John Lilley, 2013-09-21, 13:55
[expand - 2 more] - RE: Task status query - HDFS - [mail # user]
...Thanks Harsh!  The data-transport format is pretty easy, but how is the RPC typically set up?  Does the AM open a listen port to accept the RPC from the tasks, and then pass the po...
   Author: John Lilley, 2013-09-21, 13:52
[expand - 2 more] - RE: yarn-site.xml and aux-services - HDFS - [mail # user]
...https://issues.apache.org/jira/browse/YARN-1151  From: Harsh J [mailto:[EMAIL PROTECTED]]  Sent: Thursday, September 05, 2013 12:14 PM To:  Subject: Re: yarn-site.xml and aux-...
   Author: John Lilley, 2013-09-05, 20:08
[expand - 3 more] - RE: Containers and CPU - HDFS - [mail # user]
...Sandy, Thanks, I think I understand.  So it only makes a difference if cgroups is on AND the AM requests multiple cores?  E.g. if each task wants 4 cores the RM would only allow tw...
   Author: John Lilley, 2013-07-02, 19:28
MapReduce (59)
Hadoop (26)
HDFS (17)
Avro (1)
HBase (1)
mail # user (30)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (30)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (241)
Tsz Wo (203)
Jing Zhao (175)
Chris Nauroth (166)
Arpit Agarwal (152)
Andrew Wang (143)
Aaron T. Myers (141)
Haohui Mai (141)
Suresh Srinivas (138)
Brandon Li (137)
Kihwal Lee (114)
Daryn Sharp (105)
Ted Yu (83)
Uma Maheswara Rao G (82)
Alejandro Abdelnur (73)
Tsz Wo Nicholas Sze (64)
Konstantin Shvachko (63)
Akira AJISAKA (61)
Stephen Chu (58)
Yongjun Zhang (56)
Steve Loughran (54)
Allen Wittenauer (49)
John Lilley