Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper >> mail # user >> ExecutorService over a zookeeper


+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-11, 17:51
+
Thomas Koch 2011-02-13, 16:10
+
Ted Dunning 2011-02-13, 20:05
+
Aaron Crow 2011-02-13, 21:35
+
Mahadev Konar 2011-02-13, 22:00
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-14, 08:35
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-14, 08:48
+
Ted Dunning 2011-02-14, 15:23
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-15, 09:51
Copy link to this message
-
Re: ExecutorService over a zookeeper
Віталій Тимчишин:
> 2011/2/14 Ted Dunning <[EMAIL PROTECTED]>
>
> > Scalability.
> >
> > Zookeeper is limited to a few 10's of thousands of updates per second.
> >
> >  Large updates would limit this even more.
> >
> > If that is enough, then great.  If not, too bad.
>
> Yep, it's enough. Remeber, it's executor service. It has no sense to
> cluster a task that will take less then 100 millis in average. So, taking
> 10 updates per task, it should handle 10000s/10*0.1 = 100s parallel tasks.
> Its OK. It will handle a cluster of ~20 powerfull cluster nodes. If I will
> have more, I can easily have a set of independant servers with tasks
> distributed over them.
>
> BTW: Does this number change with new servers or replication makes it
> worse?

Maybe the gearman project is more suitable to your needs?
http://gearman.org

Thomas Koch, http://www.koch.ro
+
=?KOI8-U?B?96bUwcymyiD0yc... 2011-02-15, 17:03
+
Ted Dunning 2011-02-15, 15:37
+
Jake Mannix 2011-02-13, 20:35
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB