Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Want to add data in same file in Apache PIG?

Copy link to this message
Re: Want to add data in same file in Apache PIG?
One thing you can do though, is to let pig create new files every time and
have a post-pig task/job to combine the old file and the new file.

It's a little abnormal to require a single file on HDFS. Normally, MR or
other jobs deal with a folder of files, not just a single file.

On Thu, Jul 18, 2013 at 4:49 AM, Serega Sheypak <[EMAIL PROTECTED]>wrote:

> it's not possible. It's HDFS.
> 2013/7/18 Bhavesh Shah <[EMAIL PROTECTED]>
> > Hello,
> >
> > Actually I have a use case in which I will receive the data from some
> > source and I have to dump it in the same file after every regular
> interval
> > and use that file for further operation. I tried to search on it, but I
> > didn't see the anything related to this.
> >
> > I am using STORE function, but STORE function always create new file with
> > specified name and gives error if the specified  file already exists.
> > How should I do store the data in same file? Is it possible in Pig or
> have
> > some work around for it?
> > Please suggest me some solution over this.
> >
> >
> > Thanks,
> > Bhavesh Shah