Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Date Function in Pig


Copy link to this message
-
Re: Date Function in Pig
Or still you can use JODA Time API bundled with PIG.
On 27 August 2013 17:15, Ruslan Al-Fakikh <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I think the easiest way would be to use the piggybank converstion functions
> for such tasks:
>
> http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/datetime/convert/
>
> Best Regards,
> Ruslan
>
>
> On Mon, Aug 26, 2013 at 7:43 PM, Serega Sheypak <[EMAIL PROTECTED]
> >wrote:
>
> > You can use REGEX_EXTRACT with appropriate pattern and dummy ternary
> > operator
> > or
> > write dummy jython UDF using java/jython classes for Datetime conversion
> > or
> > You can convert it to unix seconds using "native pig" and sort as
> integers:
> >
> > dataWithSeconds = FOREACH dataWithddMMMyyyy GENERATE
> >
> > (int)(SecondsBetween(ToDate(
> > ddMMMyyyy_field,               'ddMMMyyyy'),
> >
> >         ToDate('1970-01-01 00:00:00',   'yyyy-MM-dd HH:mm:ss'))
> >                                                        ) as seconds;
> >
> > ordered = ORDER dataWithSeconds by seconds;
> >
> >
> >
> > 2013/8/26 Ambastha, Abhishek <[EMAIL PROTECTED]>
> >
> > > Hi,
> > >
> > > I have columns defined as string where dates are in the format
> ddMMMyyyy
> > > (e.g. 01JAN2009). I would like to sort this column in ascending order.
> > For
> > > that, I need to convert string into date in the format 'ddMMMyyyy'.
> > >
> > > Please suggest how to do this.
> > >
> > > Regards,
> > > Abhishek
> > >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB