| clear query|facets|time |
Search criteria: .
Results from 1 to 9 from
9 (0.1s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Passing values from InputFormat via the Configuration object - MapReduce - [mail # user]
|
|
...I tested both options and the "hack" is the only one working. No counter can be created in the custom InputFormat. If anyone has any better alternative, please advise. On Fri, M...
|
|
|
Author: Public Network Services,
2013-05-18, 03:16
|
|
|
Passing values from InputFormat via the Configuration object - MapReduce - [mail # user]
|
|
...Hi... I need to communicate some proprietary number (long) values from the getSplits() method of a custom InputFormat class to the Hadoop driver class (used to launch the job), but the...
|
|
|
Author: Public Network Services,
2013-05-18, 00:33
|
|
|
Re: BlockMissingException - MapReduce - [mail # user]
|
|
...Very reasonable scenario, but the application I run does not delete the input files, so such a race condition could not manifest itself at any point. Funnily enough, experimenting arou...
|
|
|
Author: Public Network Services,
2013-05-15, 08:39
|
|
|
Execution handover in map/reduce pipeline - MapReduce - [mail # user]
|
|
...Hi... I have an application that processes large amounts of proprietary binary-encoded text data in the following sequence 1. Gets a URL to a file or a directory as input...
|
|
|
Author: Public Network Services,
2013-03-05, 23:35
|
|
|
Getting custom input splits from files that are not byte-aligned or line-aligned - MapReduce - [mail # user]
|
|
...Hi... I use an application that processes text files containing data records which are of variable size and not line-aligned. The application implementation includes a Java libra...
|
|
|
Author: Public Network Services,
2013-02-23, 14:13
|
|
|
Re: MapReduce processing with extra (possibly non-serializable) configuration - MapReduce - [mail # user]
|
|
...I am familiar with serialization solutions and have done quite some work in this area, but wanted to confirm that I need to follow that path. Thanks for the advice! :-) On Thu, ...
|
|
|
Author: Public Network Services,
2013-02-22, 06:26
|
|
|
Re: MapReduce processing with extra (possibly non-serializable) configuration - MapReduce - [mail # user]
|
|
...You mean save the serialized configuration object in the custom split file, retrieve that in the Mapper, reconstruct the configuration and use the rest of the split file (i.e., the actual da...
|
|
|
Author: Public Network Services,
2013-02-22, 04:11
|
|
|
Re: MapReduce processing with extra (possibly non-serializable) configuration - MapReduce - [mail # user]
|
|
...I have considered the DistributedCache and will probably be using it, but in order to have a file to cache I need to serialize the configuration object first. :-) On Thu, Feb 21, 2013...
|
|
|
Author: Public Network Services,
2013-02-22, 04:09
|
|
|
MapReduce processing with extra (possibly non-serializable) configuration - MapReduce - [mail # user]
|
|
...Hi... I am trying to put an existing file processing application into Hadoop and need to find the best way of propagating some extra configuration per split, in the form of complex and...
|
|
|
Author: Public Network Services,
2013-02-21, 21:10
|
|
|
|
