Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Injecting plans


Hey,

I wanted to run an idea by you guys. I have a use-case where I try
injecting load/store paths into the script. So if a user says A = load
'input'; I would like to add a base path to it and make it A = load
'base_path/foo/bar/input'.

I would like to achieve this programatically, and 1 way I can of doing it
is by allowing setter on LOLoad/LOStore that can modify the FileSpec. Is
there a cleaner or better way to approach this?

In the future I would probably be meddling with more than just Load/Store
(for eg, disabling rmf or mkdir commands etc) but this is something I am
looking at currently.

Thanks,
Prashant
+
Bill Graham 2013-02-12, 01:55
+
Prashant Kommireddi 2013-02-12, 02:17
+
Julien Le Dem 2013-02-12, 02:30
+
Bill Graham 2013-02-12, 03:47
+
Prashant Kommireddi 2013-02-12, 08:24
+
Julien Le Dem 2013-02-12, 17:24
+
Bill Graham 2013-02-12, 17:29
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB