Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> MPI Java bindings now available


Copy link to this message
-
Re: MPI Java bindings now available
Many thanks to Noah for his off-list help in diagnosing the problem. There was an undiagnosed VPATH build issue in OMPI that surfaced with the Java bindings. This has been fixed - the tarball generated tonight will include the patch.

Thanks again, Noah.
Ralph

On Feb 22, 2012, at 12:51 PM, Noah Watkins wrote:

> I have LD_LIBRARY_PATH pointing to the full OpenMPI installation, which seems to include the MPI libraries. Is that what you meant by OMPI libraries?
>
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ echo $LD_LIBRARY_PATH
> /home/nwatkins/projects/openmpi_java/install/lib:
>
> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ ls -l /home/nwatkins/projects/openmpi_java/install/lib
> total 19372
> -rwxr-xr-x 1 nwatkins nwatkins     1027 2012-02-22 09:49 libmca_common_sm.la
> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so -> libmca_common_sm.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       25 2012-02-22 09:49 libmca_common_sm.so.0 -> libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins    77835 2012-02-22 09:49 libmca_common_sm.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1140 2012-02-22 09:49 libmpi_java.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so -> libmpi_java.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libmpi_java.so.0 -> libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins   393888 2012-02-22 09:49 libmpi_java.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1051 2012-02-22 09:49 libmpi.la
> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so -> libmpi.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       15 2012-02-22 09:49 libmpi.so.0 -> libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins 12002747 2012-02-22 09:49 libmpi.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1003 2012-02-22 09:49 libompitrace.la
> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so -> libompitrace.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       21 2012-02-22 09:49 libompitrace.so.0 -> libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins    86113 2012-02-22 09:49 libompitrace.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-pal.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so -> libopen-pal.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-pal.so.0 -> libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins  2493981 2012-02-22 09:49 libopen-pal.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins     1081 2012-02-22 09:49 libopen-rte.la
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so -> libopen-rte.so.0.0.0
> lrwxrwxrwx 1 nwatkins nwatkins       20 2012-02-22 09:49 libopen-rte.so.0 -> libopen-rte.so.0.0.0
> -rwxr-xr-x 1 nwatkins nwatkins  4695012 2012-02-22 09:49 libopen-rte.so.0.0.0
> -rw-r--r-- 1 nwatkins nwatkins    27260 2012-02-22 09:49 mpi.jar
> drwxrwxr-x 2 nwatkins nwatkins    12288 2012-02-22 09:49 openmpi
> drwxrwxr-x 2 nwatkins nwatkins     4096 2012-02-22 09:49 pkgconfig
>
> On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote:
>
>> Hi Noah
>>
>> Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so we can find libmpi. Did you include your $prefix/lib[64] in it?
>>
>> On Feb 22, 2012, at 11:02 AM, Noah Watkins wrote:
>>
>>> Just gave the nightly release a try and I'm getting an error:
>>>
>>> nwatkins@kyoto:~/projects/openmpi_java/openmpi-1.7a1r25994/examples$ mpirun -np 1 java Hello
>>> JAVA BINDINGS FAILED TO LOAD REQUIRED LIBRARIES
>>>
>>> My setup is on the latest Ubuntu with:
>>>
>>> 1. Built with contrib/platform/hadoop/linux
>>> 2. Compiled example with mpijavac
>>> 3. LD_LIBRARY_PATH set to /mpi/java/install/lib
>>>
>>> Looks like Java is loading libmpi_java successfully, and something is going awry with the library magic in mpi_MPI.c:loadGlobalLibraries()
>>>
>>> Thanks,
>>> Noah
>>>
>>> On Feb 21, 2012, at 3:05 PM, Ralph Castain wrote:
>>>
>