Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper >> mail # user >> SQS Implementation with ZooKeeper


+
Mike Schilli 2011-12-06, 19:16
+
Patrick Hunt 2011-12-06, 19:21
+
Jordan Zimmerman 2011-12-06, 19:21
+
Neha Narkhede 2011-12-06, 19:39
+
Ted Dunning 2011-12-06, 19:41
Copy link to this message
-
Re: SQS Implementation with ZooKeeper
This is exactly what Hedwig does.
John as Neha mentioned,
 You might want to look at Kafka/Hedwig/ActiveMQ.

mahadev

On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunning <[EMAIL PROTECTED]> wrote:
> ZK definitely provides the raw material for something like SQS.
>
> Generally, however, a queue *in* ZK isn't quite as good an idea as a queue
> that is *coordinated* by ZK, mostly for performance reasons.  Thus Pat's
> suggestion to look at Bookkeeper is not a bad one at all.  A direct clone
> of SQS that pushes state to ZK for fail-over purposes would be very easy to
> build.
>
>
> On Tue, Dec 6, 2011 at 11:16 AM, Mike Schilli <[EMAIL PROTECTED]> wrote:
>
>> Seems like it should be possible to implement a queue service like
>> Amazon's SQS [1] with ZooKeeper, with queue items becoming 'invisible'
>> once a client picks them, but pop back into the queue after a timeout
>> unless the client doesn't explicitly delete them.
>>
>> Anyone done that?
>>
>> --
>> -- Mike
>>
>> Mike Schilli
>> [EMAIL PROTECTED]
>>
>> [1] http://aws.amazon.com/sqs
>>
+
Mahadev Konar 2011-12-06, 20:45
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB