Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> HBaseStorage and setBatch()


Copy link to this message
-
Re: HBaseStorage and setBatch()
I don't recall anyone looking into setBatch. Sounds like a good enhancement
to me.

On Thu, Mar 7, 2013 at 10:04 AM, Norbert Burger <[EMAIL PROTECTED]>wrote:

> We're using HBaseStorage to read some large rows (50k cols) and hitting
> some perf issues (responseTooSlow and responseTooLarge in RS logs).
>  Looking through the code, I see that there's not an option that wraps
> setBatch(), as opposed to the existing setCaching().  Small change, but I'm
> wondering if anyone's already dug into this?  If not, I'll take a look.
>  Unfortunately, it also seems there's not a hbase.client.scanner.batch
> prop.
>
> Thanks,
> Norbert
>