Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo >> mail # user >> Failed to load native map library: libNativeMap-Linux-i386-32.so


Copy link to this message
-
Re: Failed to load native map library: libNativeMap-Linux-i386-32.so
4G is not too small.

The problem here is that Accumulo has a setting for how much memory the tablet server should try to use, in this case 1G for map memory and 500MB for block cache while the JVM is capped at 256MB. This is actually a known, old problem and the defaults need to be fixed if they haven't already.

Change -Xmx256m to -Xmx2G or some value larger than your map memory + block cache size on the line defining ACCUMULO_TSERVER_OPTS

The other option is to reduce the 1G and 500M figures, which can be done through the accumulo-site.xml file by adding or changing the following lines (I think the second value is tserver.cache.data.size but it may be named something else ... )  :

<property>
<name>tserver.memory.maps.max</name>
<value>200MB</value>
</property>

<property>
<name>tserver.cache.data.size</name>
<value>50MB</value>
</property>
In a standalone setup you don't really want to swap, so reducing the settings in accumulo-site.xml to allow everything to fit comfortably in memory is the way to go. No matter what settings you choose, the JVM max in accumulo-env.sh should be set to a greater value than the sum of the two values in accumulo-site.xml
> 589,299,712 is too large for this
> JVM configuration 261,750,784

On Dec 30, 2011, at 12:26 AM, David Medinets wrote:

> The output is i686.
>
> I was looking in the wrong log file.  When I look in
> tserver_ubuntu20gb.log this is what I see. I obviously have the jvm
> settings wrong.
>
> 30 00:21:01,238 [tabletserver.TabletServer] ERROR: Uncaught exception
> in TabletServer.main, exiting
> java.lang.IllegalArgumentException: Maximum tablet server map memory
> 1,073,741,824 and block cache sizes 589,299,712 is too large for this
> JVM configuration 261,750,784
>
> My virtualbox instance has 4,096Mb of memory. With hadoop and
> zookeeper running, this is the results of 'free -k'
>
> $ free -k
>             total       used       free     shared    buffers     cached
> Mem:       4128460    2190868    1937592          0     223872    1123444
> -/+ buffers/cache:     843552    3284908
> Swap:      4192252          0    4192252
>
> I am trying to change the jvm settings. So far without luck,
>
> test -z "$ACCUMULO_TSERVER_OPTS" && export
> ACCUMULO_TSERVER_OPTS="${POLICY} -Xmx256m -Xms256m -Xss128k"
> test -z "$ACCUMULO_MASTER_OPTS"  && export
> ACCUMULO_MASTER_OPTS="${POLICY} -Xmx256m -Xms256m"
> test -z "$ACCUMULO_MONITOR_OPTS" && export
> ACCUMULO_MONITOR_OPTS="${POLICY} -Xmx128m -Xms128m"
> test -z "$ACCUMULO_GC_OPTS"      && export ACCUMULO_GC_OPTS="-Xmx256m -Xms256m"
> test -z "$ACCUMULO_LOGGER_OPTS"  && export
> ACCUMULO_LOGGER_OPTS="-Xmx128m -Xms128m"
> test -z "$ACCUMULO_GENERAL_OPTS" && export
> ACCUMULO_GENERAL_OPTS="-XX:+UseConcMarkSweepGC
> -XX:CMSInitiatingOccupancyFraction=75"
> test -z "$ACCUMULO_OTHER_OPTS"   && export
> ACCUMULO_OTHER_OPTS="-Xmx128m -Xms128m"
>
> Is 4,096Mb just too small?
>
> On Thu, Dec 29, 2011 at 11:36 PM, Trevor Adams <[EMAIL PROTECTED]> wrote:
>> What is the output of `uname -m`, since that g++ command is still trying to
>> generate a 64bit executable (-m64). That could also explain the complaints
>> about incompatible libraries.
>> -Trevor
>>
>>
>> On Thu, Dec 29, 2011 at 11:31 PM, John W Vines <[EMAIL PROTECTED]>
>> wrote:
>>>
>>>
>>>
>>> ----- Original Message -----
>>> | From: "David Medinets" <[EMAIL PROTECTED]>
>>> | To: "accumulo-user" <[EMAIL PROTECTED]>
>>> | Sent: Thursday, December 29, 2011 6:52:47 PM
>>> | Subject: Failed to load native map library:
>>> libNativeMap-Linux-i386-32.so
>>> | I am trying to get the following command to run:
>>> |
>>> | bin/accumulo shell -u root
>>> |
>>> | and still getting the "Failed to find an available server in the list
>>> | of servers" message.
>>> |
>>> | --
>>> | -- How to make libNativeMap optional?
>>> | --
>>> |
>>> | In tserver_ubuntu20gb.debug.log, I am seeing this error:
>>> |
>>> | Failed to load native map library
>>> |
>>> /home/ubuntu/accumulo-1.5.0-incubating-SNAPSHOT/lib/native/map/libNativeMap-Linux-i386-32.so
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB