Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> How to set JVM arguments in Hadoop 0.23


Copy link to this message
-
Re: How to set JVM arguments in Hadoop 0.23
Btw, you can also set a global JAVA_LIBRARY_PATH env-var containing
your paths, and YARN will pick it up.

On Wed, Sep 12, 2012 at 9:16 AM, Harsh J <[EMAIL PROTECTED]> wrote:
> Hi Shekhar,
>
> For YARN, try setting YARN_OPTS inside the yarn-env.sh. YARN scripts
> do not reuse the hadoop-env.sh like the rest of the components. The
> yarn-env.sh must reside in the YARN_CONF_DIR directory.
>
> Does this help?
>
> On Wed, Sep 12, 2012 at 8:07 AM, Shekhar Gupta <[EMAIL PROTECTED]> wrote:
>> I am trying to talk to R from Resource Manager. To do that I have to set a
>> VM argument
>>
>> -Djava.library.path=/Library/Frameworks/R.framework/Resources/library/rJava/jri/
>>
>>
>>
>> I have tried to set this argument by adding following line in hadoop-env.sh
>> export HADOOP_OPTS="-Djava.library.path=/Library/Frameworks/R.framework/Resources/library/rJava/jri/
>> $HADOOP_OPTS"
>>
>>
>>
>> But this not working. When I run a job I get following exception
>>
>> Cannot find JRI native library!
>> Please make sure that the JRI native library is in a directory listed
>> in java.library.path.
>>
>> java.lang.UnsatisfiedLinkError: no jri in java.library.path
>>         at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1758)
>>         at java.lang.Runtime.loadLibrary0(Runtime.java:823)
>>         at java.lang.System.loadLibrary(System.java:1045)
>>         at org.rosuda.JRI.Rengine.<clinit>(Rengine.java:19)
>>         at org.apache.hadoop.yarn.server.resourcemanager.scheduler.parcscheduler.parcscheduler.doneApplication(parcscheduler.java:454)
>>         at org.apache.hadoop.yarn.server.resourcemanager.scheduler.parcscheduler.parcscheduler.handle(parcscheduler.java:927)
>>         at org.apache.hadoop.yarn.server.resourcemanager.scheduler.parcscheduler.parcscheduler.handle(parcscheduler.java:1)
>>         at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$SchedulerEventDispatcher$EventProcessor.run(ResourceManager.java:327)
>>         at java.lang.Thread.run(Thread.java:680)
>>
>>
>>
>> Can someone please tell me how to set this VM argument.
>>
>> Thanks in advance.
>
>
>
> --
> Harsh J

--
Harsh J
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB