Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Thoughts



On Jul 15, 2014, at 10:42 AM, Rodrigo Ferreira <[EMAIL PROTECTED]> wrote:

Seems totally reasonable to me, albeit laborious. Be sure to set pig.splitCombination to false. Alternatively, you could try the approach here and write your own simple inputFormat: http://thedatachef.blogspot.com/2013/08/using-hadoop-to-explore-chaos.html Similar ideas in that the "input" is actually just a very small file and numerous simulations are run in parallel using pig.

Can you explain further? It's not clear what you're trying to do/what isn't working.

@thedatachef