Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Zookeeper >> mail # user >> building an distribuited mail-store UID generator using zookeeper


Copy link to this message
-
Re: building an distribuited mail-store UID generator using zookeeper
Would Twitter's snowflake @ https://github.com/twitter/snowflake help here?

On Wed, Jan 25, 2012 at 11:06 PM, Ioan Eugen Stan <[EMAIL PROTECTED]> wrote:
> Hello Norman,
>
> 2012/1/25 Norman Maurer <[EMAIL PROTECTED]>:
>> Hi Ioan,
>>
>> did you read this:
>>
>> http://www.mail-archive.com/[EMAIL PROTECTED]/msg01967.html
>
> I have read it now. I will look over the code for H1 [1] and also try
> to contact the developer to get some info about how well it scales.
>
> The other idea that I had in regard to uid generation is very well
> described by Ted in this mail [2]: create servers that do uid
> generation and use Zk to coordinate them, somewhat similar to what
> region servers do in HBase. Each server will be responsible for
> creating uids for a shard of mailboxes.
>
> Clients will interrogate ZK to get the list of servers and then
> connect to the server they need for each mailbox.
>
>>
>> bye,
>> norman
>
>
> [1] https://github.com/talis/H1
> [2] http://mail-archives.apache.org/mod_mbox/zookeeper-user/201201.mbox/browser
>
> --
> Ioan Eugen Stan
> http://ieugen.blogspot.com/

--
Harsh J
Customer Ops. Engineer, Cloudera
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB