-Re: Dump all changes on ZK to file
kishore g 2011-09-14, 00:40
This only gives me the hugh level information something like
ZooKeeper Transactional Log File with dbid 0 txnlog format version 2
8/15/11 1:55:36 PM PDT session 0x131cf1a236f0014 cxid 0x0 zxid 0xf01
8/15/11 1:55:57 PM PDT session 0x131cf1a236f0000 cxid 0x55f zxid 0xf02
8/15/11 1:56:00 PM PDT session 0x131cf1a236f0015 cxid 0x0 zxid 0xf03
8/15/11 2:00:33 PM PDT session 0x131cf1a236f001c cxid 0x36 zxid 0xf6b
8/15/11 2:00:33 PM PDT session 0x131cf1a236f0021 cxid 0xa1 zxid 0xf6c create
8/15/11 2:00:33 PM PDT session 0x131cf1a236f001b cxid 0x3e zxid 0xf6d
8/15/11 2:00:33 PM PDT session 0x131cf1a236f001e cxid 0x3e zxid 0xf6e
8/15/11 2:00:33 PM PDT session 0x131cf1a236f001d cxid 0x41 zxid 0xf6f
How can get more details about the transaction itself. I want to know which
node was created deleted what was set etc. Is this possible ?
On Tue, Sep 13, 2011 at 4:47 PM, kishore g <[EMAIL PROTECTED]> wrote:
> Thanks Ben, that's exactly what I was looking for.
> On Tue, Sep 13, 2011 at 4:43 PM, Benjamin Reed <[EMAIL PROTECTED]> wrote:
>> you can do this using the logs. there is a log format utility:
>> LogFormatter that will print the log in a human readable format that
>> you could use to get this information. (actually you might need to
>> enhance the tool a bit depending on the detail that you want.)
>> On Tue, Sep 13, 2011 at 3:53 PM, kishore g <[EMAIL PROTECTED]> wrote:
>> > Hi,
>> > I want to dump all changes that happen on ZK to a file.
>> > What I am trying to do is following
>> > - Set up some application specific structure on zookeeper.
>> > - Start a listener or something equivalent that watches on all the
>> > - Multiple processes are connected to Zookeeper and they make some
>> > changes on the ZK as needed
>> > - The listener will detect the changes and dump the changes to a file
>> > some structure
>> > - Once the run is over there will be a verification tool which will go
>> > over the change log and do some verifications.
>> > I am not sure if there is already a tool to do this or if it is possible
>> > get all changes from ZK server logs.
>> > I am aware that if we have a separate listener we may not be able to get
>> > changes since I might miss changes between receiving a notification and
>> > change happening before i reset the watch. This may not be the case with
>> > logs/snapshot.
>> > This will not be in production but I want to use it to for testing. Idea
>> > to decouple verification from simulation so that all types of
>> > can be done based on the change log.
>> > Any pointers/suggestions ?
>> > thanks,
>> > Kishore G