Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Building LZO on hadoop


Copy link to this message
-
Building LZO on hadoop
Saptarshi Guha 2009-04-01, 18:29
I checked out hadoop-core-0.19
export CFLAGS=$CUSTROOT/include
export LDFLAGS=$CUSTROOT/lib

(they contain lzo which was built with --shared)
>ls $CUSTROOT/include/lzo/
lzo1a.h  lzo1b.h  lzo1c.h  lzo1f.h  lzo1.h  lzo1x.h  lzo1y.h  lzo1z.h
lzo2a.h  lzo_asm.h  lzoconf.h  lzodefs.h  lzoutil.h

>ls $CUSTROOT/lib/
liblzo2.so  liblzo.a  liblzo.la  liblzo.so  liblzo.so.1  liblzo.so.2
liblzo.so.2.0.0

I then run (from hadoop-core-0.19.1/)
ant -Dcompile.native=true

I get messages like : (many others like this)
exec] configure: WARNING: lzo/lzo1x.h: accepted by the compiler,
rejected by the preprocessor!
     [exec] configure: WARNING: lzo/lzo1x.h: proceeding with the
compiler's result
     [exec] checking for lzo/lzo1x.h... yes
     [exec] checking Checking for the 'actual' dynamic-library for
'-llzo2'... (cached)
     [exec] checking lzo/lzo1y.h usability... yes
     [exec] checking lzo/lzo1y.h presence... no
     [exec] configure: WARNING: lzo/lzo1y.h: accepted by the compiler,
rejected by the preprocessor!
     [exec] configure: WARNING: lzo/lzo1y.h: proceeding with the
compiler's result
     [exec] checking for lzo/lzo1y.h... yes
     [exec] checking Checking for the 'actual' dynamic-library for
'-llzo2'... (cached)

and finally,
ive/src/org/apache/hadoop/io/compress/lzo/LzoCompressor.c  -fPIC -DPIC
-o .libs/LzoCompressor.o
     [exec] /ln/meraki/custom/hadoop-core-0.19.1/src/native/src/org/apache/hadoop/io/compress/lzo/LzoCompressor.c:
In function 'Java_org_apache_hadoop_io_compress_lzo_LzoCompressor_initIDs':
     [exec] /ln/meraki/custom/hadoop-core-0.19.1/src/native/src/org/apache/hadoop/io/compress/lzo/LzoCompressor.c:137:
error: expected expression before ',' token
Any ideas?
Saptarshi Guha