Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> SQS Implementation with ZooKeeper


Copy link to this message
-
Re: SQS Implementation with ZooKeeper
This is exactly what Hedwig does.
John as Neha mentioned,
 You might want to look at Kafka/Hedwig/ActiveMQ.

mahadev

On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunning <[EMAIL PROTECTED]> wrote:
> ZK definitely provides the raw material for something like SQS.
>
> Generally, however, a queue *in* ZK isn't quite as good an idea as a queue
> that is *coordinated* by ZK, mostly for performance reasons.  Thus Pat's
> suggestion to look at Bookkeeper is not a bad one at all.  A direct clone
> of SQS that pushes state to ZK for fail-over purposes would be very easy to
> build.
>
>
> On Tue, Dec 6, 2011 at 11:16 AM, Mike Schilli <[EMAIL PROTECTED]> wrote:
>
>> Seems like it should be possible to implement a queue service like
>> Amazon's SQS [1] with ZooKeeper, with queue items becoming 'invisible'
>> once a client picks them, but pop back into the queue after a timeout
>> unless the client doesn't explicitly delete them.
>>
>> Anyone done that?
>>
>> --
>> -- Mike
>>
>> Mike Schilli
>> [EMAIL PROTECTED]
>>
>> [1] http://aws.amazon.com/sqs
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB