Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 12 (0.289s).
Loading phrases to help you
refine your search...
Re: How to find out what file Hadoop is looking for - Hadoop - [mail # user]
...This looks like a log dir problem:   at org.apache.hadoop.mapred.JobLocalizer.initializeJobLogDir(JobLocalizer. java:239)  looking through the source for JobLocalizer, it's trying ...
   Author: Chris White, 2012-04-03, 18:57
[expand - 2 more] - Re: how to unit test my RawComparator - Hadoop - [mail # user]
...When hadoop is merging spill outputs, or merging map outputs in the reducer, then i can see two byte arrays being used.  WIth regards to pass by reference vs value, you're right, the by...
   Author: Chris White, 2012-04-01, 17:33
Re: what is the code for WritableComparator.readVInt and WritableUtils.decodeVIntSize doing? - Hadoop - [mail # user]
...A text object is written out as a vint representing the number of bytes and then the byte array contents of the text object  Because a vintage can be between 1-5 bytes in length, the de...
   Author: Chris White, 2012-03-31, 17:17
Re: is implementing WritableComparable and setting Job.setSortComparatorClass(...) redundant? - Hadoop - [mail # user]
...Setting sortComparatorClass will allow you to configure a RawComparator implementation (allowing you to do more efficient comparisons at the byte level). If you don't set it then hadoop uses...
   Author: Chris White, 2012-03-20, 10:30
[MAPREDUCE-1572] MapReduceDriver combiner functionality - MapReduce - [issue]
...the MapReduceDriver for the new API should be updated to allow the configuration of a Combiner...
http://issues.apache.org/jira/browse/MAPREDUCE-1572    Author: Chris White, 2012-03-19, 16:56
[MAPREDUCE-1569] Mock Contexts & Configurations - MapReduce - [issue]
...Currently the library creates a new Configuration object in the MockMapContext and MocKReduceContext constructors, rather than allowing the developer to configure and pass their own...
http://issues.apache.org/jira/browse/MAPREDUCE-1569    Author: Chris White, 2012-03-15, 07:47
Re: Partition classes, how to pass in background information - Hadoop - [mail # user]
...If your class implements the configurable interface, hadoop will call the setConf method after creating the instance. Look in the source code for ReflectionUtils.newInstance for more info On...
   Author: Chris White, 2012-03-14, 10:06
Re: Hadoop in Action Partitioner Example - Hadoop - [mail # user]
...Job.setGroupingComparatorClass will allow you to define a RawComparator class, in which you can only compare the K1 component of K. The Reduce sort will still sort all K's using the compareT...
   Author: Chris White, 2011-08-23, 23:40
[expand - 1 more] - Re: WritableComparable - Hadoop - [mail # user]
...Can you copy the contents of your parent Writable readField and write methods (not the ones youve already posted)  Another thing you could try is if you know you have two identical keys...
   Author: Chris White, 2011-08-16, 20:47
[MAPREDUCE-1570] Shuffle stage - Key and Group Comparators - MapReduce - [issue]
...Shuffle method in org.apache.hadoop.mrunit.MapReduceDriverBase doesn't currently allow the use of custom GroupingComparator and SortComparator....
http://issues.apache.org/jira/browse/MAPREDUCE-1570    Author: Chris White, 2010-08-24, 21:21
Sort:
project
Hadoop (8)
MapReduce (4)
type
mail # user (8)
issue (3)
mail # dev (1)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (12)
author
Ted Yu (1832)
Harsh J (1303)
Jun Rao (1014)
Todd Lipcon (994)
Stack (985)
Andrew Purtell (875)
Jonathan Ellis (854)
stack (758)
Jean-Daniel Cryans (751)
Jarek Jarcec Cecho (747)
Yusaku Sako (743)
Eric Newton (707)
Jonathan Hsieh (682)
Hitesh Shah (679)
Roman Shaposhnik (677)
Josh Elser (674)
Steve Loughran (651)
Namit Jain (648)
Siddharth Seth (643)
Brock Noland (634)
Owen O'Malley (623)
Hyunsik Choi (582)
Neha Narkhede (566)
Arun C Murthy (548)
Eli Collins (545)
Chris White
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB