Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Dynamically generating load/store path


Copy link to this message
-
Dynamically generating load/store path
Greetings,

Is there a way to dynamically generate (maybe via UDF) the path to
load/store data? (something like "A = LOAD InputPath() USING PigStorage();")

Currently we calculate the load/store path outside the pig script and pass
it as parameter. However we'd like to have a UDF that does that.

Thanks,
--
Miki
+
Jonathan Coveney 2012-11-14, 00:45
+
Prashant Kommireddi 2012-11-14, 00:55
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB