Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - problem with LZO compressor on write only loads


Copy link to this message
-
Re: problem with LZO compressor on write only loads
Andrey Stepachev 2011-01-12, 04:49
Yes, I tried.

2011/1/12 Sandy Pratt <[EMAIL PROTECTED]>

> I'm curious if you've tried -XX:MaxDirectMemorySize=256m (or whatever
> value).
>
> > -----Original Message-----
> > From: Andrey Stepachev [mailto:[EMAIL PROTECTED]]
> > Sent: Tuesday, January 11, 2011 12:58
> > To: [EMAIL PROTECTED]
> > Subject: Re: problem with LZO compressor on write only loads
> >
> > Not only with LZO, but with regular gzip I got the same issue (on sun and
> > jrocket jvm). Looks like some bug for me. Don't know how to beat this
> bug.
> >
> > 2011/1/3 Friso van Vollenhoven <[EMAIL PROTECTED]>
> >
> > > Hi all,
> > >
> > > I seem to run into a problem that occurs when using LZO compression on
> > > a heavy write only load. I am using 0.90 RC1 and, thus, the LZO
> > > compressor code that supports the reinit() method (from Kevin Weil's
> > > github, version 0.4.8). There are some more Hadoop LZO incarnations,
> > > so I am pointing my question to this list.
> > >
> > > Thanks,
> > > Friso
> > >
> > >
>