On Jul 15, 2014, at 10:42 AM, Rodrigo Ferreira <[EMAIL PROTECTED]> wrote:
Seems totally reasonable to me, albeit laborious. Be sure to set pig.splitCombination to false. Alternatively, you could try the approach here and write your own simple inputFormat: http://thedatachef.blogspot.com/2013/08/using-hadoop-to-explore-chaos.html Similar ideas in that the "input" is actually just a very small file and numerous simulations are run in parallel using pig.
Can you explain further? It's not clear what you're trying to do/what isn't working.