Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Drill >> mail # dev >> questions, about Allocator and subscan


+
Lisen Mu 2013-08-26, 08:11
+
Jacques Nadeau 2013-08-27, 03:35
Copy link to this message
-
Re: questions, about Allocator and subscan
J,

Thanks for the reply. I don't have much thought on memory management yet
either. I'll see what I can do.
On Tue, Aug 27, 2013 at 11:35 AM, Jacques Nadeau <[EMAIL PROTECTED]> wrote:

> Good questions...
>
>
> * I can see in recent submissions about scan/subscan and scan/endpoint
> assignment. Is there any document to cover the design considerations of
> this part?
>
> -- Not really, we need to put something together.  We'll try to get on that
> in the next week or two.
>
> * Is there any recommended way to monitor and diagnostic off-heap memory
> usage?
> -- There aren't a lot of tools yet.  We need to add the sub allocators per
> query which would then at least allow us to know allocation per segment.  I
> think we're pushing new territory in general with our memory management
> approach within Java so any ideas of how to manage better would be much
> appreciated.
>
> j
>
>
>
> On Mon, Aug 26, 2013 at 1:11 AM, Lisen Mu <[EMAIL PROTECTED]> wrote:
>
> > Hi,
> >
> > since I missed the last 2 opportunities to ask in hangout, and likely to
> > miss more in the near future, I would like to post the questions here:
> >
> > * I can see in recent submissions about scan/subscan and scan/endpoint
> > assignment. Is there any document to cover the design considerations of
> > this part?
> >
> > * Is there any recommended way to monitor and diagnostic off-heap memory
> > usage?
> >
> > Thanks,
> >
> > Lisen
> >
>