Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Giving additional jars to my job


Copy link to this message
-
Re: Giving additional jars to my job
You can use -libjars <additional-jars> .
See
http://hadoop.apache.org/common/docs/r0.20.0/mapred_tutorial.html#Usage
for more details.

Thanks
Amareshwari
Mark Kerzner wrote:
> Thanks, toiling on the shell script now, but I agree, it's easy
>
> On Tue, Jul 28, 2009 at 2:57 PM, tim robertson <[EMAIL PROTECTED]>wrote:
>
>  
>> I just use the assembly plugin with maven...
>>
>> I think you can do it pretty easily with ant as well though.
>>
>> Cheers
>> Tim
>>
>> On Tue, Jul 28, 2009 at 9:54 PM, Mark Kerzner<[EMAIL PROTECTED]>
>> wrote:
>>    
>>> By the way, could you recommend a script for packaging up the jar with
>>>      
>> all
>>    
>>> dependencies?
>>>
>>> On Tue, Jul 28, 2009 at 2:28 PM, Mark Kerzner <[EMAIL PROTECTED]>
>>>      
>> wrote:
>>    
>>>> I am leaning towards packaging; I see this to be the simplest
>>>>
>>>>
>>>> On Tue, Jul 28, 2009 at 2:25 PM, tim robertson <
>>>>        
>> [EMAIL PROTECTED]>wrote:
>>    
>>>>> A couple of ways I know of is to add them to the Hadoop classpath
>>>>> itself in the env.sh or to package up your jar with all it's
>>>>> dependencies.  The later is the approach I take.
>>>>>
>>>>> Cheers
>>>>>
>>>>> Tim
>>>>>
>>>>>
>>>>> On Tue, Jul 28, 2009 at 8:20 PM, Mark Kerzner<[EMAIL PROTECTED]>
>>>>> wrote:
>>>>>          
>>>>>> Hi,
>>>>>> take for example this line
>>>>>>
>>>>>> bin/hadoop jar /usr/joe/wordcount.jar org.myorg.WordCount
>>>>>> /usr/joe/wordcount/input /usr/joe/wordcount/output
>>>>>>
>>>>>> How do I give additional jars?
>>>>>>
>>>>>> Thank you,
>>>>>> Mark
>>>>>>
>>>>>>            
>>>>        
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB