Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Copy the content of the input splits

Copy link to this message
Re: Copy the content of the input splits
I don't know any helper class doing it but you could simply open a local
file and with your mapper write all the key/value which are provided.
Now the question is why would you want to do that? If it is in preparation
of a map join, you might want to user a higher abstraction tool (cascading,
pig, hive ...). You also may want to check out how DistributedCache works.



On Thu, Aug 23, 2012 at 5:18 AM, Grandl Robert <[EMAIL PROTECTED]> wrote:

> Hi,
> Do you know how I can copy using Hadoop code the content of input splits
> into local files ? I saw something like InputSplit class but still not able
> to figure out how to copy it. Is there somewhere in the code something
> similar I can look at ?
> Thanks,
> Robert
Bertrand Dechoux