Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Importing register/define statements?


Copy link to this message
-
Re: Importing register/define statements?
What happens if you s/import/exec/ ?

D

On Sat, Apr 28, 2012 at 11:25 PM, Russell Jurney
<[EMAIL PROTECTED]> wrote:
> I tried that, it doesn't work. Docs indicate you can't register in a macro,
> which is what import is.
>
> Russell Jurney http://datasyndrome.com
>
> On Apr 28, 2012, at 11:18 PM, Ashish Gite <[EMAIL PROTECTED]> wrote:
>
> Other option would be:
>
> import '../path/to/common.pig';
>
> This allows reusing pig code. So one can keep all the register, define etc
> in one file & keep including it in other pig scripts. Works pig 0.9.x
> onwards.
>
> Sent from Mobile
>
>  ------------------------------
> * From: * Russell Jurney <[EMAIL PROTECTED]>;
> * To: * <[EMAIL PROTECTED]>;
> * Subject: * Re: Importing register/define statements?
> * Sent: * Sun, Apr 29, 2012 1:22:46 AM
>
>  That makes sense. I can copy the jars and organize them that way.
>
> Is it possible to zip multiple jars into one jar, and then load that jar?
>
> On Sat, Apr 28, 2012 at 6:18 PM, Prashant Kommireddi
> <[EMAIL PROTECTED]<javascript:return>
>>wrote:
>
>> You would ideally not want to load jars you don't use. Can you create
>> a directory containing jars specific to this script?
>>
>> On Apr 28, 2012, at 6:13 PM, Russell Jurney <[EMAIL PROTECTED]<javascript:return>
>>
>> wrote:
>>
>> > There are tons more jars in that directory that I don't need. Is there a
>> > reason to be concerned about loading all of them?
>> >
>> > On Sat, Apr 28, 2012 at 6:03 PM, Prashant Kommireddi <
>> [EMAIL PROTECTED] <javascript:return>>wrote:
>> >
>> >> In pig 0.10 you can glob these jars in your pig script.
>> >>
>> >> Register path/*.jar
>> >>
>> >> Sent from my iPhone
>> >>
>> >> On Apr 28, 2012, at 4:22 PM, Russell Jurney <[EMAIL PROTECTED]<javascript:return>
>>
>> >> wrote:
>> >>
>> >>> I have a lot of pig stuff like this:
>> >>>
>> >>> /* Load Avro jars and define shortcut */
>> >>> register /me/pig/build/ivy/lib/Pig/avro-1.5.3.jar
>> >>> register /me/pig/build/ivy/lib/Pig/json-simple-1.1.jar
>> >>> register /me/pig/build/ivy/lib/Pig/jackson-core-asl-1.7.3.jar
>> >>> register /me/pig/build/ivy/lib/Pig/jackson-mapper-asl-1.7.3.jar
>> >>> register /me/pig/build/ivy/lib/Pig/joda-time-1.6.jar
>> >>>
>> >>> define AvroStorage
> org.apache.pig.piggybank.storage.avro.AvroStorage();
>> >>>
>> >>>
>> >>> I hate to paste it in every file. Is there a way to load this stuff in
>> >> one
>> >>> line, like a macro? Macros can't register.
>> >>>
>> >>> --
>> >>> Russell Jurney twitter.com/rjurney [EMAIL PROTECTED]<javascript:return>
>> >> datasyndrome.com
>> >>
>> >
>> >
>> >
>> > --
>> > Russell Jurney twitter.com/rjurney [EMAIL PROTECTED]<javascript:return>
>> datasyndrome.com
>>
>
>
>
> --
> Russell Jurney twitter.com/rjurney [EMAIL PROTECTED]<javascript:return>
> datasyndrome.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB