Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Zookeeper, mail # user - Dump all changes on ZK to file


+
kishore g 2011-09-13, 22:53
+
Benjamin Reed 2011-09-13, 23:43
Copy link to this message
-
Re: Dump all changes on ZK to file
kishore g 2011-09-13, 23:47
Thanks Ben, that's exactly what I was looking for.

On Tue, Sep 13, 2011 at 4:43 PM, Benjamin Reed <[EMAIL PROTECTED]> wrote:

> you can do this using the logs. there is a log format utility:
> LogFormatter that will print the log in a human readable format that
> you could use to get this information. (actually you might need to
> enhance the tool a bit depending on the detail that you want.)
>
> ben
>
> On Tue, Sep 13, 2011 at 3:53 PM, kishore g <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > I want to dump all changes that happen on ZK to a file.
> >
> > What I am trying to do is following
> >
> >   - Set  up some application specific structure on zookeeper.
> >   - Start a listener or something equivalent that watches on all the
> nodes.
> >   - Multiple processes are connected to Zookeeper and they make some
> >   changes on the ZK as needed
> >   - The listener will detect the changes and dump the changes to a file
> in
> >   some structure
> >   - Once the run is over there will be a verification tool which will go
> >   over the change log and do some verifications.
> >
> > I am not sure if there is already a tool to do this or if it is possible
> to
> > get all changes from ZK server logs.
> >
> > I am aware that if we have a separate listener we may not be able to get
> all
> > changes since I might miss changes between receiving a notification and a
> > change happening before i reset the watch. This may not be the case with
> ZK
> > logs/snapshot.
> >
> > This will not be in production but I want to use it to for testing. Idea
> is
> > to decouple verification from simulation so that all types of
> verification
> > can be done based on the change log.
> >
> > Any pointers/suggestions ?
> >
> > thanks,
> > Kishore G
> >
>
+
kishore g 2011-09-14, 00:40
+
kishore g 2011-09-14, 06:44
+
Patrick Hunt 2011-09-14, 17:37
+
kishore g 2011-09-14, 18:58