Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 12 (0.174s).
Loading phrases to help you
refine your search...
Re: How to find out what file Hadoop is looking for - Hadoop - [mail # user]
...This looks like a log dir problem:   at org.apache.hadoop.mapred.JobLocalizer.initializeJobLogDir(JobLocalizer. java:239)  looking through the source for JobLocalizer, it's trying ...
   Author: Chris White, 2012-04-03, 18:57
[expand - 2 more] - Re: how to unit test my RawComparator - Hadoop - [mail # user]
...When hadoop is merging spill outputs, or merging map outputs in the reducer, then i can see two byte arrays being used.  WIth regards to pass by reference vs value, you're right, the by...
   Author: Chris White, 2012-04-01, 17:33
Re: what is the code for WritableComparator.readVInt and WritableUtils.decodeVIntSize doing? - Hadoop - [mail # user]
...A text object is written out as a vint representing the number of bytes and then the byte array contents of the text object  Because a vintage can be between 1-5 bytes in length, the de...
   Author: Chris White, 2012-03-31, 17:17
Re: is implementing WritableComparable and setting Job.setSortComparatorClass(...) redundant? - Hadoop - [mail # user]
...Setting sortComparatorClass will allow you to configure a RawComparator implementation (allowing you to do more efficient comparisons at the byte level). If you don't set it then hadoop uses...
   Author: Chris White, 2012-03-20, 10:30
[MAPREDUCE-1572] MapReduceDriver combiner functionality - MapReduce - [issue]
...the MapReduceDriver for the new API should be updated to allow the configuration of a Combiner...
http://issues.apache.org/jira/browse/MAPREDUCE-1572    Author: Chris White, 2012-03-19, 16:56
[MAPREDUCE-1569] Mock Contexts & Configurations - MapReduce - [issue]
...Currently the library creates a new Configuration object in the MockMapContext and MocKReduceContext constructors, rather than allowing the developer to configure and pass their own...
http://issues.apache.org/jira/browse/MAPREDUCE-1569    Author: Chris White, 2012-03-15, 07:47
Re: Partition classes, how to pass in background information - Hadoop - [mail # user]
...If your class implements the configurable interface, hadoop will call the setConf method after creating the instance. Look in the source code for ReflectionUtils.newInstance for more info On...
   Author: Chris White, 2012-03-14, 10:06
Re: Hadoop in Action Partitioner Example - Hadoop - [mail # user]
...Job.setGroupingComparatorClass will allow you to define a RawComparator class, in which you can only compare the K1 component of K. The Reduce sort will still sort all K's using the compareT...
   Author: Chris White, 2011-08-23, 23:40
[expand - 1 more] - Re: WritableComparable - Hadoop - [mail # user]
...Can you copy the contents of your parent Writable readField and write methods (not the ones youve already posted)  Another thing you could try is if you know you have two identical keys...
   Author: Chris White, 2011-08-16, 20:47
[MAPREDUCE-1570] Shuffle stage - Key and Group Comparators - MapReduce - [issue]
...Shuffle method in org.apache.hadoop.mrunit.MapReduceDriverBase doesn't currently allow the use of custom GroupingComparator and SortComparator....
http://issues.apache.org/jira/browse/MAPREDUCE-1570    Author: Chris White, 2010-08-24, 21:21
Hadoop (8)
MapReduce (4)
mail # user (8)
issue (3)
mail # dev (1)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (12)
Ted Yu (1698)
Harsh J (1294)
Todd Lipcon (995)
Stack (978)
Jun Rao (970)
Jonathan Ellis (844)
Andrew Purtell (816)
Jean-Daniel Cryans (752)
Yusaku Sako (720)
stack (714)
Jarek Jarcec Cecho (703)
Eric Newton (688)
Jonathan Hsieh (673)
Roman Shaposhnik (663)
Namit Jain (649)
Hitesh Shah (627)
Owen O'Malley (625)
Steve Loughran (624)
Siddharth Seth (614)
Josh Elser (561)
Brock Noland (550)
Neha Narkhede (546)
Eli Collins (545)
Arun C Murthy (543)
Doug Cutting (536)
Chris White