Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - how to set system properties for mapper/reducer?


Copy link to this message
-
Re: how to set system properties for mapper/reducer?
Ted Yu 2010-10-08, 00:48
If you look at the parameters passed to your mapper/reducer, you should see
something like this:

-Djava.library.path=/opt//hadoop/bin/../lib/native/Linux-amd64-64:/tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201010062322_0002/attempt_201010062322_0002_m_000000_0/work

On Thu, Oct 7, 2010 at 5:12 PM, Yin Lou <[EMAIL PROTECTED]> wrote:

> I don't understand. I want to pass something like
> java.library.path="/home/.../libXXX.so" so that every mapper can load that
> lib and use the native code.
>
> Could you give me an example?
>
> Thanks!
>  Yin
>
>
> On Thu, Oct 7, 2010 at 6:05 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> Take a look at bin/hadoop:
>> hadoop:  HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"
>>
>>
>> On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>
>>> Is there any way to pass system properties, like java.library.path to
>>> each mapper/reducer?
>>>
>>> Thanks,
>>> Yin
>>>
>>
>>
>