Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Put whole path into -tagsource?

Dmitriy Ryaboy 2012-08-02, 21:31
Copy link to this message
Re: Put whole path into -tagsource?
Hi Dmitriy,

Adding a new flag would be the way in my opinion. I have often seen
users interested in the file name only but it wouldn't harm to provide
an option to be able to read the entire path. Changing tag source
would not be backward compatible.

Can you please open a JIRA? I can work on this.


On Aug 2, 2012, at 2:31 PM, Dmitriy Ryaboy <[EMAIL PROTECTED]> wrote:

> Hi all,
> I advised a user to use the new -tagsource option for PigStorage
> recently, but it wasn't useful for him because it only contains the
> filename (in this case, MR output like "part-m-00000.lzo"). He'd
> really like to get the full path, instead. Can we change tagsource to
> do that? Or perhaps add yet another flag?
> What do you think?
> D
Dmitriy Ryaboy 2012-08-02, 23:17