Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # dev - ingest performance oscillations and Xceivers


Copy link to this message
-
Re: ingest performance oscillations and Xceivers
John Vines 2013-01-04, 01:10
I think so, because I got it on the first Terry when I was directly listed

Sent from my phone, please pardon the typos and brevity.
On Jan 3, 2013 8:06 PM, "Kepner, Jeremy - 0553 - MITLL" <[EMAIL PROTECTED]>
wrote:

> Here it is again.  It got sent the last time. Does the e-mail list strip
> out attachments?
>
> On Jan 3, 2013, at 7:47 PM, Josh Elser wrote:
>
> > I think you missed your attachment :)
> >
> > On 01/03/2013 07:31 PM, Kepner, Jeremy - 0553 - MITLL wrote:
> >> Attached is the log for a set for 3 ingests.  The first hump is with 1
> ingestor, the second hump is with 2 ingestors, and the third hump is with 3
> ingestors.  The 3 ingestor case starts oscillating about 21:40. I don't see
> any spikes in any of the fields.  It would be nice if there was also a plot
> of Xceivers since I think that anti-correlates.  I do sometimes see the
> hold times highlighted in red.  The values are usually in hundreds of msec.
> >>
> >> On Jan 3, 2013, at 6:04 PM, John Vines wrote:
> >>
> >>> How many hard drives and what's your max minor/maor compactions set to?
> >>> These can severely limit your performance due to potential disk
> thrashing.
> >>> If you observe the monitor, when ingest starts trailing, do you see it
> >>> undergoing, or possibly being backed up on, any form of compaction? And
> >>> lastly, are you see the bug eric mentioned above? See if the monitor is
> >>> reporting any warnings like those mentioned.
>
>