Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Javascript UDF return Empty results


Copy link to this message
-
RE: Javascript UDF return Empty results
Hi,
 
Unfortunately , I'm using PIG build 0.9.3 (Part of the HortonWorks deployment for Azure Service)>
I've checked documentation for the 0.9.2 build and the AddDuration isn't included (Nor does any other Date Manipulation).

Is there any JAR out there which I could use if no solution to the JavaScript is found ?
 
Thanks,
 
Eran
 
> Date: Tue, 18 Jun 2013 16:46:47 -0400
> Subject: Re: Javascript UDF return Empty results
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> Take a look at these. Do they help?
> http://pig.apache.org/docs/r0.11.0/func.html#add-duration
> http://pig.apache.org/docs/r0.11.1/api/index.html?org/apache/pig/piggybank/evaluation/datetime/diff/package-tree.html
> http://pig.apache.org/docs/r0.11.0/api/org/apache/pig/piggybank/evaluation/datetime/DiffDate.html
>
> Regards,
> Shahab
>
>
> On Tue, Jun 18, 2013 at 4:28 PM, Eran Sagi <[EMAIL PROTECTED]> wrote:
>
> > Hi Shahab,
> >
> > Thanks for the fast replay!,
> >
> > Yes, the reason is that I'm looking for a DateAdd capabilities, while the
> > piggybank (as I understand it), handles only format conversion.
> > I'll appreciate if you can refer me to any samples of using Piggybank for
> > DateAdd calculations.
> >
> > Thanks,
> >
> > Eran
> >
> >
> >
> > > Date: Tue, 18 Jun 2013 13:17:19 -0400
> > > Subject: Re: Javascript UDF return Empty results
> > > From: [EMAIL PROTECTED]
> > > To: [EMAIL PROTECTED]
> > >
> > > Is there a special reason you are writing your own function? Have you
> > taken
> > > a look at the following:
> > >
> > http://pig.apache.org/docs/r0.11.0/api/org/apache/pig/piggybank/evaluation/datetime/convert/ISOToUnix.html
> > >
> > > Regards,
> > > Shahab
> > >
> > >
> > > On Tue, Jun 18, 2013 at 11:36 AM, Eran Sagi <[EMAIL PROTECTED]>
> > wrote:
> > >
> > > > Hi,
> > > > I’ve written a PIG LATIN batch which loads a CSV file.
> > > >  To support DateAdd calculation I’ve written and registered a
> > javascript
> > > > function,
> > > > Although tested outside of PIG environment successfully , the DUMP
> > output
> > > > returns empty for all values.
> > > >
> > > >  Enclosed is the Java Script:
> > > >
> > > >  Calcadd.outputSchema = “result:long”;
> > > >                function Calcadd(curdate) {
> > > >                              var tmp = curdate.replace(“-”, “/”);
> > > >                      var tmp = tmp.replace(“-”, “/”);
> > > >                      var tmp2 = new Date(tmp);
> > > >                      tmp2.setDate(tmp2.getDate() – 7);
> > > >                      var y = tmp2.getFullYear();
> > > >                             var m = (tmp2.getMonth()+1);
> > > >                             var d = tmp2.getUTCDate();
> > > >                             var result = (y * 10000 + m * 100 + d);
> > > >                        return {long:result};
> > > >    }
> > > >
> > > > Enclosed is the register tag of the batch:
> > > >
> > > > register ‘C:\Samples\Calc.Js’ using javascript as myfunctions;
> > > >
> > > > Enclosed is the invocation:
> > > >  D = FOREACH C GENERATE DeviceID, CountryTwoLetterName,
> > > > myfunctions.Calcadd(tmpDATE) as newData;
> > > >  E = DUMP D;
> > > >
> > > > the tmpDate field is a 10 character char array : ’2012-04-21′
> > > >  Representing 4Y-MM-DD structure
> > > >  The Dump statement returns empty values for the ‘newData’ field (the
> > > > output of the UDF)
> > > >
> > > > I’ll appreciate and insights
> > > >  Thanks,
> > > > Eran
> > > >
> > > >
> >
     
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB