Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 10 (0.096s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Reading json format input - HDFS - [mail # user]
...for that, you have to only write intermediate data if word = "text"  String[] words = line.split("\\W+");   for (String word : words) {      if (word.equals("text"))...
   Author: Rishi Yadav, 2013-05-30, 00:15
[expand - 1 more] - Re: The minimum memory requirements to datanode and namenode? - HDFS - [mail # user]
...can you tell specs of node3. Even on a test/demo cluster, anything below 4 GB ram makes the node almost inaccessible as per my experience.    On Sun, May 12, 2013 at 8:25 PM, sam l...
   Author: Rishi Yadav, 2013-05-13, 04:50
Re: M/R job to a cluster? - HDFS - [mail # user]
...check core-site.xml and see value of fs.default.name. if it has localhost you are running locally.     On Fri, Apr 26, 2013 at 1:59 PM,  wrote:  ...
   Author: Rishi Yadav, 2013-04-26, 21:06
Re: M/R Staticstics - HDFS - [mail # user]
...do you see "retired jobs" on job tracker page. There is also "job tracker history" on the bottom of page.  something like this http://nn.zettabyte.com:50030/jobtracker.jsp  Thanks ...
   Author: Rishi Yadav, 2013-04-26, 15:37
Re: Errors about MRunit - HDFS - [mail # user]
...your problem is simple, you are mixing mapred (old api) and mapreduce(new api) libraries. MRUnit has implementation for both apis.  Here's an example of WordCountTest with use of new ap...
   Author: Rishi Yadav, 2013-04-20, 16:19
Re: Writing intermediate key,value pairs to file and read it again - HDFS - [mail # user]
...writing a map only job will do the trick for you.   On Sat, Apr 20, 2013 at 8:43 AM, Vikas Jadhav wrote:  ...
   Author: Rishi Yadav, 2013-04-20, 16:03
Re: good way to debug map reduce code - HDFS - [mail # user]
...pseudo-distributed mode is the only way you can test your code as far as I know. This means that you are running a single node cluster. Are you using eclipse?  Thanks and Regards,  ...
   Author: Rishi Yadav, 2012-12-26, 06:48
Re: Map Shuffle Bytes - HDFS - [mail # user]
...Shuffled bytes go to reducers not mappers and the inbuilt counter for that is "Reduce Shuffle Bytes".  I am not sure how you can implement user defined java counter here because this ph...
   Author: Rishi Yadav, 2012-12-26, 06:30
Re: reducer tasks start time issue - HDFS - [mail # user]
...Hi Lin,  Reduce task starts as soon as output is ready from Mappers. The reduce method does not get called until all Mappers are done. If that's not the case, all operations which are n...
   Author: Rishi Yadav, 2012-12-22, 16:09
Re: Test failures on a released version - HDFS - [mail # user]
...Hi Mark,  Your issue seems to be related to this jira item  https://issues.apache.org/jira/browse/HDFS-3902  This issue has been fixed on 9/12 (courtesy Andy Isaacson). I woul...
   Author: Rishi Yadav, 2012-12-21, 23:12
HDFS (9)
MapReduce (7)
Spark (3)
Hadoop (1)
Hive (1)
mail # user (10)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (10)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (240)
Tsz Wo (203)
Jing Zhao (175)
Chris Nauroth (166)
Arpit Agarwal (152)
Andrew Wang (143)
Aaron T. Myers (141)
Haohui Mai (139)
Suresh Srinivas (138)
Brandon Li (137)
Kihwal Lee (114)
Daryn Sharp (105)
Ted Yu (83)
Uma Maheswara Rao G (82)
Alejandro Abdelnur (73)
Tsz Wo Nicholas Sze (64)
Konstantin Shvachko (63)
Akira AJISAKA (61)
Stephen Chu (58)
Yongjun Zhang (57)
Steve Loughran (53)
Allen Wittenauer (49)
Rishi Yadav