Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Want to add data in same file in Apache PIG?


Copy link to this message
-
Re: Want to add data in same file in Apache PIG?
One thing you can do though, is to let pig create new files every time and
have a post-pig task/job to combine the old file and the new file.

It's a little abnormal to require a single file on HDFS. Normally, MR or
other jobs deal with a folder of files, not just a single file.

Regards,
Xuefu
On Thu, Jul 18, 2013 at 4:49 AM, Serega Sheypak <[EMAIL PROTECTED]>wrote:

> it's not possible. It's HDFS.
>
>
> 2013/7/18 Bhavesh Shah <[EMAIL PROTECTED]>
>
> > Hello,
> >
> > Actually I have a use case in which I will receive the data from some
> > source and I have to dump it in the same file after every regular
> interval
> > and use that file for further operation. I tried to search on it, but I
> > didn't see the anything related to this.
> >
> > I am using STORE function, but STORE function always create new file with
> > specified name and gives error if the specified  file already exists.
> > How should I do store the data in same file? Is it possible in Pig or
> have
> > some work around for it?
> > Please suggest me some solution over this.
> >
> >
> > Thanks,
> > Bhavesh Shah
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB