Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Input and output path

Copy link to this message
Re: Input and output path
On Mon, Sep 10, 2012 at 4:17 PM, Ruslan Al-Fakikh <[EMAIL PROTECTED]>wrote:

> Mohit,
> I guess you could use parameters substitution here
> http://wiki.apache.org/pig/ParameterSubstitution
> thanks this works.
> Also, a note about your architecture:

Are you suggesting change to the path names or your suggestion is to use
HCatalog with pig?
> You can consider using Hive partitions to effectively select
> appropriate dates in the folder names. But as your tool is Pig, not
> Hive, you can use HCatalog as a layer
> Best Regards
> On Tue, Sep 11, 2012 at 3:11 AM, Mohit Anchlia <[EMAIL PROTECTED]>
> wrote:
> > Our input path is something like YYYY/MM/DD/HH/input and we like to write
> > to YYYY/MM/DD/HH/output . Is it possible to get the input path as a
> String
> > and convert it to YYYY/MM/DD/HH/output that I can use in "store into"
> > clause?