-Re: Want to add data in same file in Apache PIG?
Xuefu Zhang 2013-07-18, 16:43
One thing you can do though, is to let pig create new files every time and
have a post-pig task/job to combine the old file and the new file.
It's a little abnormal to require a single file on HDFS. Normally, MR or
other jobs deal with a folder of files, not just a single file.
On Thu, Jul 18, 2013 at 4:49 AM, Serega Sheypak <[EMAIL PROTECTED]>wrote:
> it's not possible. It's HDFS.
> 2013/7/18 Bhavesh Shah <[EMAIL PROTECTED]>
> > Hello,
> > Actually I have a use case in which I will receive the data from some
> > source and I have to dump it in the same file after every regular
> > and use that file for further operation. I tried to search on it, but I
> > didn't see the anything related to this.
> > I am using STORE function, but STORE function always create new file with
> > specified name and gives error if the specified file already exists.
> > How should I do store the data in same file? Is it possible in Pig or
> > some work around for it?
> > Please suggest me some solution over this.
> > Thanks,
> > Bhavesh Shah