Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper >> mail # user >> ExecutorService over a zookeeper


+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-11, 17:51
+
Thomas Koch 2011-02-13, 16:10
+
Ted Dunning 2011-02-13, 20:05
+
Aaron Crow 2011-02-13, 21:35
+
Mahadev Konar 2011-02-13, 22:00
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-14, 08:35
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-14, 08:48
+
Ted Dunning 2011-02-14, 15:23
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-15, 09:51
Copy link to this message
-
Re: ExecutorService over a zookeeper
Віталій Тимчишин:
> 2011/2/14 Ted Dunning <[EMAIL PROTECTED]>
>
> > Scalability.
> >
> > Zookeeper is limited to a few 10's of thousands of updates per second.
> >
> >  Large updates would limit this even more.
> >
> > If that is enough, then great.  If not, too bad.
>
> Yep, it's enough. Remeber, it's executor service. It has no sense to
> cluster a task that will take less then 100 millis in average. So, taking
> 10 updates per task, it should handle 10000s/10*0.1 = 100s parallel tasks.
> Its OK. It will handle a cluster of ~20 powerfull cluster nodes. If I will
> have more, I can easily have a set of independant servers with tasks
> distributed over them.
>
> BTW: Does this number change with new servers or replication makes it
> worse?

Maybe the gearman project is more suitable to your needs?
http://gearman.org

Thomas Koch, http://www.koch.ro
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-15, 17:03
+
Ted Dunning 2011-02-15, 15:37
+
Jake Mannix 2011-02-13, 20:35