Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> MPI Java bindings now available


Copy link to this message
-
Re: MPI Java bindings now available
Many thanks to Noah for his off-list help in diagnosing the problem. There was an undiagnosed VPATH build issue in OMPI that surfaced with the Java bindings. This has been fixed - the tarball generated tonight will include the patch.

Thanks again, Noah.
Ralph

On Feb 22, 2012, at 12:51 PM, Noah Watkins wrote:

> I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, which seems to include the MPI libraries. Is that what you meant by OMPI libraries?
>
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ echo $LD_LIBRARY_PATH
> /home/nwatkins/projects/openmpi_java/install/lib:
>
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ ls -l /home/nwatkins/projects/openmpi_java/install/lib
> total 19372
> -rwxr-xr-x 1 nwatkins nwatkins     1027 2012-02-22 09:49 libmca_common_sm.la
> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so -> libmca_common_sm.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so.0 -> libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins    77835 2012-02-22 09:49 libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1140 2012-02-22 09:49 libmpi_java.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so -> libmpi_java.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so.0 -> libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins   393888 2012-02-22 09:49 libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1051 2012-02-22 09:49 libmpi.la
> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so -> libmpi.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so.0 -> libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1003 2012-02-22 09:49 libompitrace.la
> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so -> libompitrace.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so.0 -> libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins    86113 2012-02-22 09:49 libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-pal.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so -> libopen-pal.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so.0 -> libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins  2493981 2012-02-22 09:49 libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-rte.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so -> libopen-rte.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so.0 -> libopen-rte.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins  4695012 2012-02-22 09:49 libopen-rte.so.0.0.0
> -rw-r--r-- 1 nwatkins nwatkins    27260 2012-02-22 09:49 mpi.jar
> drwxrwxr-x 2 nwatkins nwatkins    12288 2012-02-22 09:49 openmpi
> drwxrwxr-x 2 nwatkins nwatkins     4096 2012-02-22 09:49 pkgconfig
>
> On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
>
>> Hi Noah
>>
>> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so we can find libmpi. Did you include your $prefix/lib[64] in it?
>>
>> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>>
>>> Just gave the nightly release a try and I'm getting an error:
>>>
>>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ mpirun -np 1 java Hello
>>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>>
>>> My setup is on the latest Ubuntu with:
>>>
>>> 1. Built with contrib/platform/hadoop/linux
>>> 2. Compiled example with mpijavac
>>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>>
>>> Looks like Java is loading libmpi_java successfully, and something is going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>>
>>> Thanks,
>>> Noah
>>>
>>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB