Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Combining small S3 inputs


Copy link to this message
-
Re: Combining small S3 inputs
Pig implements its own input split. It's really a list of underlying input
splits. Take a look at PigSplit.java-
https://github.com/apache/pig/blob/trunk/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigSplit.java
On Tue, Jun 17, 2014 at 2:02 PM, Brian Stempin <[EMAIL PROTECTED]> wrote: