Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper, mail # user - SQS Implementation with ZooKeeper


Copy link to this message
-
Re: SQS Implementation with ZooKeeper
Mahadev Konar 2011-12-06, 20:45
Sorry not John, Mike :)...

mahadev

PS: not getting enough sleep! :)

On Tue, Dec 6, 2011 at 12:44 PM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
> This is exactly what Hedwig does.
> John as Neha mentioned,
>  You might want to look at Kafka/Hedwig/ActiveMQ.
>
> mahadev
>
> On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunning <[EMAIL PROTECTED]> wrote:
>> ZK definitely provides the raw material for something like SQS.
>>
>> Generally, however, a queue *in* ZK isn't quite as good an idea as a queue
>> that is *coordinated* by ZK, mostly for performance reasons.  Thus Pat's
>> suggestion to look at Bookkeeper is not a bad one at all.  A direct clone
>> of SQS that pushes state to ZK for fail-over purposes would be very easy to
>> build.
>>
>>
>> On Tue, Dec 6, 2011 at 11:16 AM, Mike Schilli <[EMAIL PROTECTED]> wrote:
>>
>>> Seems like it should be possible to implement a queue service like
>>> Amazon's SQS [1] with ZooKeeper, with queue items becoming 'invisible'
>>> once a client picks them, but pop back into the queue after a timeout
>>> unless the client doesn't explicitly delete them.
>>>
>>> Anyone done that?
>>>
>>> --
>>> -- Mike
>>>
>>> Mike Schilli
>>> [EMAIL PROTECTED]
>>>
>>> [1] http://aws.amazon.com/sqs
>>>