Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 11 to 20 from 29 (0.119s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Backwards compatibility of FileSystem interface. - HDFS - [mail # dev]
...For context - It appears that over time the FileSystem has changed the signature to the "createNonRecursive" method, (in 2.x there are 3 signatures, in 1.x, there are 2 signatures).  [r...
   Author: Jay Vyas, 2013-05-31, 13:58
Re: What else can be built on top of YARN. - HDFS - [mail # user]
...What is the separation of concerns between YARN and Zookeeper?  That is, where does YARN leave off and where does Zookeeper begin?  Or is there some overlap....   On Thu, May ...
   Author: Jay Vyas, 2013-05-30, 12:29
Re: understanding souce code structure - HDFS - [mail # user]
...Hi!  a few weeks ago I had the same question... Tried a first iteration at documenting this by going through the classes starting with key/value pairs in the blog post below.   &nb...
   Author: Jay Vyas, 2013-05-27, 18:22
[expand - 1 more] - Re: partition as block? - HDFS - [mail # user]
...Yes it is a problem at the first stage.  What I'm wondering, though, is wether the intermediate results - which happen after the mapper phase - can be optimized.   On Tue, Apr 30, ...
   Author: Jay Vyas, 2013-04-30, 19:59
transfer -> CreateSocketForPipeline : hardcoded length of 2? - HDFS - [mail # dev]
...Hi guys: I noticed that in the call to createSocketForPipeline, there is a hardcoded length of "2".  //from sock = createSocketForPipeline(src, 2, dfsClient);  This cascades down t...
   Author: Jay Vyas, 2013-04-23, 13:25
Re: Append MR output file to an exitsted HDFS file - HDFS - [mail # user]
...I might be misunderstanding, but if you want each Reducer to append its outputs to outputs to corresponding files that already exist in HDFS?  Remember that the reducers usually are out...
   Author: Jay Vyas, 2013-04-22, 04:04
Re: Writing intermediate key,value pairs to file and read it again - HDFS - [mail # user]
...How many intermediate keys? If small enough, you can keep them in memory.  If large, you can just wait for the job to finish and siphon them into your job as input with the MultipleInpu...
   Author: Jay Vyas, 2013-04-20, 16:06
[expand - 1 more] - Re: Convention question for using DFSConfigKey constants : are zeros magic? - HDFS - [mail # dev]
...Thanks ! okay that helps to clarify things.  Okay, so the value in referencing the static comment is that it is commented in the DFS_KEYS file, and declared as 0.  Having the ==0 i...
   Author: Jay Vyas, 2013-04-19, 22:40
MapReduce Integration tests for test FileSystems - HDFS - [mail # dev]
...MapReduce has some very demanding file operations at at job submission time, and is an important integration test for any hadoop compliant FileSystem.  How in the hadoop HDFS source tre...
   Author: Jay Vyas, 2013-04-13, 20:46
[expand - 1 more] - Re: testHDFSConf.xml - HDFS - [mail # dev]
...Thats great. Yes this is certainly something we could benefit from.  But the "trunk" github appears to only have "./src/test/hdfs/org/apache/hadoop/cli/testHDFSConf.xml" in the source t...
   Author: Jay Vyas, 2013-04-11, 13:14
Bigtop (99)
Hadoop (90)
MapReduce (53)
HDFS (25)
HBase (18)
Hive (11)
Pig (11)
Spark (3)
Flume (2)
Ambari (1)
mail # user (20)
mail # dev (9)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (29)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (240)
Tsz Wo (203)
Jing Zhao (175)
Chris Nauroth (166)
Arpit Agarwal (152)
Andrew Wang (143)
Aaron T. Myers (141)
Haohui Mai (139)
Suresh Srinivas (138)
Brandon Li (137)
Kihwal Lee (114)
Daryn Sharp (105)
Ted Yu (83)
Uma Maheswara Rao G (82)
Alejandro Abdelnur (73)
Tsz Wo Nicholas Sze (64)
Konstantin Shvachko (63)
Akira AJISAKA (61)
Stephen Chu (58)
Yongjun Zhang (57)
Steve Loughran (53)
Allen Wittenauer (49)
Jay Vyas