Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> how to get rid of -libjars ?


Copy link to this message
-
Re: how to get rid of -libjars ?
If you're using -libjars, there's no reason to copy the jars into
$HADOOP lib. You may have to add the jars to the HADOOP_CLASSPATH if
you use them from your main() method:

export HADOOP_CLASSPATH=dependent-1.jar,dependent-2.jar
hadoop jar main.jar demo.MyJob -libjars
dependent-1.jar,dependent-2.jar -Dmapred.input.dir=/input/path
-Dmapred.output.dir=/output/path

-Joey

On Tue, Mar 6, 2012 at 10:37 AM, Jane Wayne <[EMAIL PROTECTED]> wrote:
> currently, i have my main jar and then 2 depedent jars. what i do is
> 1. copy dependent-1.jar to $HADOOP/lib
> 2. copy dependent-2.jar to $HADOOP/lib
>
> then, when i need to run my job, MyJob inside main.jar, i do the following.
>
> hadoop jar main.jar demo.MyJob -libjars dependent-1.jar,dependent-2.jar
> -Dmapred.input.dir=/input/path -Dmapred.output.dir=/output/path
>
> what i want to do is NOT copy the dependent jars to $HADOOP/lib and always
> specify -libjars. is there any way around this multi-step procedure? i
> really do not want to clutter $HADOOP/lib or specify a comma-delimited list
> of jars for -libjars.
>
> any help is appreciated.

--
Joseph Echeverria
Cloudera, Inc.
443.305.9434