Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - Multiple CurrentTime calls return the same timestamp


+
Danfeng Li 2013-02-27, 00:09
+
Cheolsoo Park 2013-02-27, 00:51
Copy link to this message
-
Re: Multiple CurrentTime calls return the same timestamp
Jonathan Coveney 2013-02-27, 09:30
This is by design, as the notion of a CurrentTime() in a Pig job is a big
poorly specified, so we went with something "unremarkable." What do you
think it should be?
2013/2/27 Cheolsoo Park <[EMAIL PROTECTED]>

> Hi Dan,
>
> Are you using 0.11 or trunk?
>
> If you're using trunk, please take a look at PIG-3014.
> https://issues.apache.org/jira/browse/PIG-3014
>
> Thanks,
> Cheolsoo
>
>
>
> On Tue, Feb 26, 2013 at 4:09 PM, Danfeng Li <[EMAIL PROTECTED]>
> wrote:
>
> > I called CurrentTime() twice in my pig code, but the final results are
> end
> > up as the same timestamp.
> >
> > The code is following:
> >
> > A = load 'test.txt' as (a:chararray);
> > dump A;
> > B = foreach A generate a, CurrentTime();
> > dump B;
> > C = foreach B generate a as a,
> >     $1 as time1,
> >     CurrentTime() as time2;
> > dump C;
> >
> > The results are
> >
> > A:
> > (adg_daadf)
> > (test_Test)
> >
> > B:
> > (adg_daadf,2013-02-26T16:04:55.049-08:00)
> > (test_Test,2013-02-26T16:04:55.049-08:00)
> >
> > C:
> > (adg_daadf,2013-02-26T16:05:08.979-08:00,2013-02-26T16:05:08.979-08:00)
> > (test_Test,2013-02-26T16:05:08.979-08:00,2013-02-26T16:05:08.979-08:00)
> >
> > Note how the time1 and time2 in "C" are the same, and time1 is different
> > from the time in B.
> >
> > Are this a bug or a feature?
> >
> > If this is a feature, how do I preserve the timestamp in B.
> >
> > Thanks.
> > Dan
> >
> >
>
+
Danfeng Li 2013-02-27, 19:02
+
Jonathan Coveney 2013-02-27, 22:49