-Re: Input and output path
Mohit Anchlia 2012-09-10, 23:29
On Mon, Sep 10, 2012 at 4:17 PM, Ruslan Al-Fakikh <[EMAIL PROTECTED]>wrote:
> I guess you could use parameters substitution here
> thanks this works.
> Also, a note about your architecture:
Are you suggesting change to the path names or your suggestion is to use
HCatalog with pig?
> You can consider using Hive partitions to effectively select
> appropriate dates in the folder names. But as your tool is Pig, not
> Hive, you can use HCatalog as a layer
> Best Regards
> On Tue, Sep 11, 2012 at 3:11 AM, Mohit Anchlia <[EMAIL PROTECTED]>
> > Our input path is something like YYYY/MM/DD/HH/input and we like to write
> > to YYYY/MM/DD/HH/output . Is it possible to get the input path as a
> > and convert it to YYYY/MM/DD/HH/output that I can use in "store into"
> > clause?