|
|
-
cleaning up old snapshot
Jun Rao 2011-06-22, 18:26
Hi,
I like to have ZK itself manage the amount of snapshots and logs kept,
instead of relying on the PurgeTxnLog utility. Is that on the roadmap
already?
Thanks,
Jun
+
Jun Rao 2011-06-22, 18:26
-
Re: cleaning up old snapshot
Mahadev Konar 2011-06-22, 18:39
Jun,
Thats a good ask. We dont have that on the roadmap yet. I think with
ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
should probably address that with ZOOKEEPER-22 in mind.
thanks
mahadev
On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I like to have ZK itself manage the amount of snapshots and logs kept,
> instead of relying on the PurgeTxnLog utility. Is that on the roadmap
> already?
>
> Thanks,
>
> Jun
>
--
thanks
mahadev
@mahadevkonar
+
Mahadev Konar 2011-06-22, 18:39
-
Re: cleaning up old snapshot
Ted Dunning 2011-06-22, 20:41
Mahadev,
What is the connection here?
On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
> Jun,
> Thats a good ask. We dont have that on the roadmap yet. I think with
> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
> should probably address that with ZOOKEEPER-22 in mind.
>
>
> thanks
> mahadev
>
> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > I like to have ZK itself manage the amount of snapshots and logs kept,
> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap
> > already?
> >
> > Thanks,
> >
> > Jun
> >
>
>
>
> --
> thanks
> mahadev
> @mahadevkonar
>
+
Ted Dunning 2011-06-22, 20:41
-
Re: cleaning up old snapshot
Mahadev Konar 2011-06-22, 21:03
Ted,
The connection is that with ZOOKEEPER-22 we will have to keep logs so
that we can go back in time. Since we might have old requests coming
along because requests will be retried, we need to keep enough logs to
keep that information available. Does that explain it?
thanks
mahadev
On Wed, Jun 22, 2011 at 1:41 PM, Ted Dunning <[EMAIL PROTECTED]> wrote:
> Mahadev,
>
> What is the connection here?
>
> On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
>
>> Jun,
>> Thats a good ask. We dont have that on the roadmap yet. I think with
>> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
>> should probably address that with ZOOKEEPER-22 in mind.
>>
>>
>> thanks
>> mahadev
>>
>> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
>> > Hi,
>> >
>> > I like to have ZK itself manage the amount of snapshots and logs kept,
>> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap
>> > already?
>> >
>> > Thanks,
>> >
>> > Jun
>> >
>>
>>
>>
>> --
>> thanks
>> mahadev
>> @mahadevkonar
>>
>
--
thanks
mahadev
@mahadevkonar
+
Mahadev Konar 2011-06-22, 21:03
-
Re: cleaning up old snapshot
Ted Dunning 2011-06-22, 21:33
Sure.
But does this have any practical significance if somebody keeps 1-2 days of
logs around?
On Wed, Jun 22, 2011 at 2:03 PM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
> Ted,
> The connection is that with ZOOKEEPER-22 we will have to keep logs so
> that we can go back in time. Since we might have old requests coming
> along because requests will be retried, we need to keep enough logs to
> keep that information available. Does that explain it?
>
> thanks
> mahadev
>
> On Wed, Jun 22, 2011 at 1:41 PM, Ted Dunning <[EMAIL PROTECTED]>
> wrote:
> > Mahadev,
> >
> > What is the connection here?
> >
> > On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]>
> wrote:
> >
> >> Jun,
> >> Thats a good ask. We dont have that on the roadmap yet. I think with
> >> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
> >> should probably address that with ZOOKEEPER-22 in mind.
> >>
> >>
> >> thanks
> >> mahadev
> >>
> >> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> >> > Hi,
> >> >
> >> > I like to have ZK itself manage the amount of snapshots and logs kept,
> >> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap
> >> > already?
> >> >
> >> > Thanks,
> >> >
> >> > Jun
> >> >
> >>
> >>
> >>
> >> --
> >> thanks
> >> mahadev
> >> @mahadevkonar
> >>
> >
>
>
>
> --
> thanks
> mahadev
> @mahadevkonar
>
+
Ted Dunning 2011-06-22, 21:33
-
Re: cleaning up old snapshot
Mahadev Konar 2011-06-22, 22:49
Not really Ted. We just have to make sure enough logs are there, if ZK
is configured to keep more htan the bare minimum, well and good!
thanks
mahadev
On Wed, Jun 22, 2011 at 2:33 PM, Ted Dunning <[EMAIL PROTECTED]> wrote:
> Sure.
>
> But does this have any practical significance if somebody keeps 1-2 days of
> logs around?
>
> On Wed, Jun 22, 2011 at 2:03 PM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
>
>> Ted,
>> The connection is that with ZOOKEEPER-22 we will have to keep logs so
>> that we can go back in time. Since we might have old requests coming
>> along because requests will be retried, we need to keep enough logs to
>> keep that information available. Does that explain it?
>>
>> thanks
>> mahadev
>>
>> On Wed, Jun 22, 2011 at 1:41 PM, Ted Dunning <[EMAIL PROTECTED]>
>> wrote:
>> > Mahadev,
>> >
>> > What is the connection here?
>> >
>> > On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Jun,
>> >> Thats a good ask. We dont have that on the roadmap yet. I think with
>> >> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
>> >> should probably address that with ZOOKEEPER-22 in mind.
>> >>
>> >>
>> >> thanks
>> >> mahadev
>> >>
>> >> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
>> >> > Hi,
>> >> >
>> >> > I like to have ZK itself manage the amount of snapshots and logs kept,
>> >> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap
>> >> > already?
>> >> >
>> >> > Thanks,
>> >> >
>> >> > Jun
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> thanks
>> >> mahadev
>> >> @mahadevkonar
>> >>
>> >
>>
>>
>>
>> --
>> thanks
>> mahadev
>> @mahadevkonar
>>
>
--
thanks
mahadev
@mahadevkonar
+
Mahadev Konar 2011-06-22, 22:49
-
Re: cleaning up old snapshot
Jun Rao 2011-06-23, 14:49
Created ZOOKEEPER-1107.
Thanks,
Jun
On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]> wrote:
> Jun,
> Thats a good ask. We dont have that on the roadmap yet. I think with
> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We
> should probably address that with ZOOKEEPER-22 in mind.
>
>
> thanks
> mahadev
>
> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > I like to have ZK itself manage the amount of snapshots and logs kept,
> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap
> > already?
> >
> > Thanks,
> >
> > Jun
> >
>
>
>
> --
> thanks
> mahadev
> @mahadevkonar
>
+
Jun Rao 2011-06-23, 14:49
-
Re: cleaning up old snapshot
Patrick Hunt 2011-06-24, 17:08
It would be good to consider https://issues.apache.org/jira/browse/ZOOKEEPER-323 as well (log reuse rather than deletion). Patrick On Thu, Jun 23, 2011 at 7:49 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > Created ZOOKEEPER-1107. > > Thanks, > > Jun > > On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]> wrote: > >> Jun, >> Thats a good ask. We dont have that on the roadmap yet. I think with >> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We >> should probably address that with ZOOKEEPER-22 in mind. >> >> >> thanks >> mahadev >> >> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote: >> > Hi, >> > >> > I like to have ZK itself manage the amount of snapshots and logs kept, >> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap >> > already? >> > >> > Thanks, >> > >> > Jun >> > >> >> >> >> -- >> thanks >> mahadev >> @mahadevkonar >> >
+
Patrick Hunt 2011-06-24, 17:08
-
Re: cleaning up old snapshot
Ted Dunning 2011-06-24, 17:33
Log re-use would be very nice. Deleting old logs is a (small) mess when packaging due to the need to edit crontab and the resulting need to investigate local operational policies. Re-using them would make ZK disk space not grow and would get rid of the cron stuff entirely. I would be surprised if the performance boost that the original reporter suggests will actually materialize, but since the original reporter is Ben, I wouldn't recommend that others emulate my surprise. On Fri, Jun 24, 2011 at 10:08 AM, Patrick Hunt <[EMAIL PROTECTED]> wrote: > It would be good to consider > https://issues.apache.org/jira/browse/ZOOKEEPER-323 as well (log reuse > rather than deletion). > > Patrick > > On Thu, Jun 23, 2011 at 7:49 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > > Created ZOOKEEPER-1107. > > > > Thanks, > > > > Jun > > > > On Wed, Jun 22, 2011 at 11:39 AM, Mahadev Konar <[EMAIL PROTECTED]> > wrote: > > > >> Jun, > >> Thats a good ask. We dont have that on the roadmap yet. I think with > >> ZOOKEEPER-22 that might be necessary. Please open a jira for that. We > >> should probably address that with ZOOKEEPER-22 in mind. > >> > >> > >> thanks > >> mahadev > >> > >> On Wed, Jun 22, 2011 at 11:26 AM, Jun Rao <[EMAIL PROTECTED]> wrote: > >> > Hi, > >> > > >> > I like to have ZK itself manage the amount of snapshots and logs kept, > >> > instead of relying on the PurgeTxnLog utility. Is that on the roadmap > >> > already? > >> > > >> > Thanks, > >> > > >> > Jun > >> > > >> > >> > >> > >> -- > >> thanks > >> mahadev > >> @mahadevkonar > >> > > >
+
Ted Dunning 2011-06-24, 17:33
|
|
