Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Using external jar in UDF


Copy link to this message
-
Re: Using external jar in UDF
Okay what do you mean by "package and send along"?  What is the pig way to include additional jars?  e.g. we want to use a 3rd party library to encode json and how can our UDF reference that jar?

On Mar 15, 2010, at 12:49 PM, Alan Gates wrote:

> The UDF interface does not currently include the ability for a UDF to indicate additional jars it would like to have packaged and sent along.
>
> Alan.
>
> On Mar 10, 2010, at 2:21 AM, Tamir Kamara wrote:
>
>> Hi,
>>
>> Register is working fine but it means that the user needs to know when it's
>> needed to register the additional jar. What about my question regarding the
>> M/R way of doing this ?
>>
>> Thanks,
>> Tamir
>>
>> On Wed, Mar 10, 2010 at 11:21 AM, Jeff Zhang <[EMAIL PROTECTED]> wrote:
>>
>>> Using *REGISTER myfunc.jar;*
>>>
>>> refer here:
>>> http://hadoop.apache.org/pig/docs/r0.5.0/piglatin_reference.html#REGISTER
>>>
>>>
>>> On Wed, Mar 10, 2010 at 4:52 PM, Tamir Kamara <[EMAIL PROTECTED]>
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> I have a function (eval) that needs to use an external jar.
>>>> In M/R world this can be accomplished by uploading the jar to the dfs and
>>>> using DistributedCache.addFileToClassPath.
>>>> How do I do the same (have the jar available for the udf) in pig?
>>>>
>>>> Thanks,
>>>> Tamir
>>>>
>>>
>>>
>>>
>>> --
>>> Best Regards
>>>
>>> Jeff Zhang
>>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB