Hi folks,
I just posted to the Apache blog on how to do performance tuning with
Flume. I plan on following it up with a post about using the Flume
monitoring capabilities while tuning. Feedback is welcome.

https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1

Regards,
Mike

Nice post!

On Fri, Jan 11, 2013 at 12:13 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> Hi folks,
> I just posted to the Apache blog on how to do performance tuning with Flume.
> I plan on following it up with a post about using the Flume monitoring
> capabilities while tuning. Feedback is welcome.
>
> https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1
>
> Regards,
> Mike
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Thanks Brock! I've been working on this, off and on, for a while. :)
On Fri, Jan 11, 2013 at 12:18 PM, Brock Noland <[EMAIL PROTECTED]> wrote:

> Nice post!
>
> On Fri, Jan 11, 2013 at 12:13 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> > Hi folks,
> > I just posted to the Apache blog on how to do performance tuning with
> Flume.
> > I plan on following it up with a post about using the Flume monitoring
> > capabilities while tuning. Feedback is welcome.
> >
> > https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1
> >
> > Regards,
> > Mike
> >
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
>

Great post, +1 man!

On Jan 11, 2013, at 9:13 PM, Mike Percy <[EMAIL PROTECTED]> wrote:

> Hi folks,
> I just posted to the Apache blog on how to do performance tuning with
> Flume. I plan on following it up with a post about using the Flume
> monitoring capabilities while tuning. Feedback is welcome.
>
> https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1
>
> Regards,
> Mike

--
Alexander Alten-Lorenz
http://mapredit.blogspot.com
German Hadoop LinkedIn Group: http://goo.gl/N8pCF

We have memoryChannel capacity set to 10000 and transactionSize set to 500.
This gives us good performance. I am trying to understand what's the
downside of using this value. Is it ok to have it so large?
webanalytics.channels.memoryChannel.capacity = 10000

webanalytics.channels.memoryChannel.transactionCapacity = 500
On Sat, Jan 12, 2013 at 12:44 AM, Alexander Alten-Lorenz <
[EMAIL PROTECTED]> wrote:

> Great post, +1 man!
>
> On Jan 11, 2013, at 9:13 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>
> > Hi folks,
> > I just posted to the Apache blog on how to do performance tuning with
> > Flume. I plan on following it up with a post about using the Flume
> > monitoring capabilities while tuning. Feedback is welcome.
> >
> > https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1
> >
> > Regards,
> > Mike
>
> --
> Alexander Alten-Lorenz
> http://mapredit.blogspot.com
> German Hadoop LinkedIn Group: http://goo.gl/N8pCF
>
>