| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
18 (0.256s).
|
|
|
Loading phrases to help you
refine your search...
|
|
sporadic failure - Hadoop - [mail # user]
|
|
...Hi, Any ideas why a staging directory would suddenly become unavailable after the completion of the map phase but before the start of the reduce phase? We noticed a sporadic fail...
|
|
|
Author: Stan Rosenberg,
2013-01-04, 21:02
|
|
|
Re: task jvm bootstrapping via distributed cache - Hadoop - [mail # user]
|
|
...On Tue, Jul 31, 2012 at 7:26 PM, Michael Segel wrote: Correct. I want to ship a jar to the task, but I need to know its absolute path before the task jvm is launched. As an...
|
|
|
Author: Stan Rosenberg,
2012-08-01, 15:12
|
|
|
Fwd: task jvm bootstrapping via distributed cache - Hadoop - [mail # user]
|
|
...Forwarding to common-user to hopefully get more exposure... From: Stan Rosenberg Date: Tue, Jul 31, 2012 at 11:55 AM Subject: Re: task jvm bootstrapping via distributed cache To...
|
|
|
Author: Stan Rosenberg,
2012-07-31, 20:50
|
|
|
hdfs inode count - Hadoop - [mail # user]
|
|
...Hi, Current filesystem api does not expose inode count. Why? FileSystem.listStatus(root) incurs too much overhead if all one needs is a count of the number of children. IN...
|
|
|
Author: Stan Rosenberg,
2012-07-20, 21:22
|
|
|
Re: CombineFileInputFormat - Hadoop - [mail # user]
|
|
...On Mon, Apr 9, 2012 at 5:29 PM, Deepak Nettem wrote: Very simply: lots of reasonably small files which I can't control, i.e., changing block size is not an option. Note tha...
|
|
|
Author: Stan Rosenberg,
2012-04-09, 21:35
|
|
|
CombineFileInputFormat - Hadoop - [mail # user]
|
|
...Hi, I just came across a use case requiring CombineFileInputFormat under hadoop 0.20.2. I was surprised that the API does not provide a default implementation. A precursory...
|
|
|
Author: Stan Rosenberg,
2012-04-09, 21:25
|
|
|
Re: custom partitioner - Hadoop - [mail # user]
|
|
...Typically, numPartitons is used as a modulus in orde to derive a value that is between zero and strictly less than numPartitons. That is, key.get() % numPartitions would yield such a v...
|
|
|
Author: Stan Rosenberg,
2012-03-25, 16:51
|
|
|
Re: race condition in hadoop 0.20.2 (cdh3u1) - Hadoop - [mail # user]
|
|
...On Tue, Jan 17, 2012 at 6:38 PM, Brock Noland wrote: Could you please refer me to where this design decision/assumption is/was documented? Imho, this assumption clashes wit...
|
|
|
Author: Stan Rosenberg,
2012-01-17, 23:51
|
|
|
race condition in hadoop 0.20.2 (cdh3u1) - Hadoop - [mail # user]
|
|
...Hi, This posting is essentially about a bug, but it is also related to a programmatic idiom endemic to hadoop. Thus, I am posting to 'common-user' as opposed to 'common-dev'; if ...
|
|
|
Author: Stan Rosenberg,
2012-01-17, 21:21
|
|
|
Re: MultipleOutputs - Create multiple files during output - Hadoop - [mail # user]
|
|
...Hi Tim, You could create a custom HashPartitioner so that all key,value pairs denoting the actions of the same user end up in the same reducer; then you need only one output file per r...
|
|
|
Author: Stan Rosenberg,
2011-09-02, 02:24
|
|
|
|
