Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Dynamically generating load/store path


+
Miki Tebeka 2012-11-14, 00:36
Copy link to this message
-
Re: Dynamically generating load/store path
If it's a parameter, it could just be passed in as a $var
2012/11/13 Miki Tebeka <[EMAIL PROTECTED]>

> Greetings,
>
> Is there a way to dynamically generate (maybe via UDF) the path to
> load/store data? (something like "A = LOAD InputPath() USING
> PigStorage();")
>
> Currently we calculate the load/store path outside the pig script and pass
> it as parameter. However we'd like to have a UDF that does that.
>
> Thanks,
> --
> Miki
>
+
Prashant Kommireddi 2012-11-14, 00:55
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB