Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> how to set system properties for mapper/reducer?


Copy link to this message
-
Re: how to set system properties for mapper/reducer?
If you look at the parameters passed to your mapper/reducer, you should see
something like this:

-Djava.library.path=/opt//hadoop/bin/../lib/native/Linux-amd64-64:/tmp/hadoop-hadoop/mapred/local/taskTracker/jobcache/job_201010062322_0002/attempt_201010062322_0002_m_000000_0/work

On Thu, Oct 7, 2010 at 5:12 PM, Yin Lou <[EMAIL PROTECTED]> wrote:

> I don't understand. I want to pass something like
> java.library.path="/home/.../libXXX.so" so that every mapper can load that
> lib and use the native code.
>
> Could you give me an example?
>
> Thanks!
>  Yin
>
>
> On Thu, Oct 7, 2010 at 6:05 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> Take a look at bin/hadoop:
>> hadoop:  HADOOP_OPTS="$HADOOP_OPTS -Djava.library.path=$JAVA_LIBRARY_PATH"
>>
>>
>> On Thu, Oct 7, 2010 at 12:04 PM, Yin Lou <[EMAIL PROTECTED]> wrote:
>>
>>> Hi,
>>>
>>> Is there any way to pass system properties, like java.library.path to
>>> each mapper/reducer?
>>>
>>> Thanks,
>>> Yin
>>>
>>
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB