Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # dev - questions, about Allocator and subscan


Copy link to this message
-
Re: questions, about Allocator and subscan
Jacques Nadeau 2013-08-27, 03:35
Good questions...
* I can see in recent submissions about scan/subscan and scan/endpoint
assignment. Is there any document to cover the design considerations of
this part?

-- Not really, we need to put something together.  We'll try to get on that
in the next week or two.

* Is there any recommended way to monitor and diagnostic off-heap memory
usage?
-- There aren't a lot of tools yet.  We need to add the sub allocators per
query which would then at least allow us to know allocation per segment.  I
think we're pushing new territory in general with our memory management
approach within Java so any ideas of how to manage better would be much
appreciated.

j

On Mon, Aug 26, 2013 at 1:11 AM, Lisen Mu <[EMAIL PROTECTED]> wrote:

> Hi,
>
> since I missed the last 2 opportunities to ask in hangout, and likely to
> miss more in the near future, I would like to post the questions here:
>
> * I can see in recent submissions about scan/subscan and scan/endpoint
> assignment. Is there any document to cover the design considerations of
> this part?
>
> * Is there any recommended way to monitor and diagnostic off-heap memory
> usage?
>
> Thanks,
>
> Lisen
>