Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - How to run pig batch?


Copy link to this message
-
How to run pig batch?
Haitao Yao 2012-02-20, 06:58
hi, all
I have tens of simple pig scripts to run. While there's no parameter name collision, I merged them into a large pig script which is about 4000 lines.
But the merged pig script takes pig a lot of time merging and analyzing.

How can I quickly submit tens of scripts in parallel?

BTW, I do not want to start tens of pig process for memory issue.
thanks very much.