hi,

After upgrade to hive 0.7, I found there will a file named 'derby.log' and
directory named 'TempStatsStore'  be created every time I run the hive job .
What does these files do? Is there a way to prevent them created ?

I don't know what TempStatsStore is, but derby.log is an artifact of using the default metastore db, derby.  I was unable to figure out a way to get derby.log to not be created or to be created in a particular directory.  I also never saw anything useful in that file.  I delete it whenever I see it.

What's in TempStatsStore?

Pat

From: wd [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, May 10, 2011 3:07 AM
To: [EMAIL PROTECTED]
Subject: What does 'TempStatsStore' do ?

hi,

After upgrade to hive 0.7, I found there will a file named 'derby.log' and directory named 'TempStatsStore'  be created every time I run the hive job . What does these files do? Is there a way to prevent them created ?

TempStatsStore is a derby database for stats gathering (intermediate stats). You can turn off stats gathering by set hive.stats.autogather=false.

On May 10, 2011, at 1:23 PM, Christopher, Pat wrote:

I don’t know what TempStatsStore is, but derby.log is an artifact of using the default metastore db, derby.  I was unable to figure out a way to get derby.log to not be created or to be created in a particular directory.  I also never saw anything useful in that file.  I delete it whenever I see it.

What’s in TempStatsStore?

Pat

From: wd [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, May 10, 2011 3:07 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: What does 'TempStatsStore' do ?

hi,

After upgrade to hive 0.7, I found there will a file named 'derby.log' and directory named 'TempStatsStore'  be created every time I run the hive job . What does these files do? Is there a way to prevent them created ?

Thanks, I found some new configure options for hive.stats, I'll change them.
2011/5/11 Ning Zhang <[EMAIL PROTECTED]>

>  TempStatsStore is a derby database for stats gathering (intermediate
> stats). You can turn off stats gathering by set
> hive.stats.autogather=false.
>
>  On May 10, 2011, at 1:23 PM, Christopher, Pat wrote:
>
>   I don’t know what TempStatsStore is, but derby.log is an artifact of
> using the default metastore db, derby.  I was unable to figure out a way to
> get derby.log to not be created or to be created in a particular directory.
> I also never saw anything useful in that file.  I delete it whenever I see
> it.
>
>  What’s in TempStatsStore?
>
>  Pat
>
>  *From:* wd [mailto:[EMAIL PROTECTED]]
> *Sent:* Tuesday, May 10, 2011 3:07 AM
> *To:* [EMAIL PROTECTED]
> *Subject:* What does 'TempStatsStore' do ?
>
>  hi,
>
>   After upgrade to hive 0.7, I found there will a file named 'derby.log'
> and directory named 'TempStatsStore'  be created every time I run the hive
> job . What does these files do? Is there a way to prevent them created ?
>
>
>

Is there some advantage to gathering stats in this case?

Thank you,
Ranjith N. Raghunath

From: wd [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, May 10, 2011 9:54 PM
To: [EMAIL PROTECTED]
Subject: Re: What does 'TempStatsStore' do ?

Thanks, I found some new configure options for hive.stats, I'll change them.
2011/5/11 Ning Zhang <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
TempStatsStore is a derby database for stats gathering (intermediate stats). You can turn off stats gathering by set hive.stats.autogather=false.

On May 10, 2011, at 1:23 PM, Christopher, Pat wrote:
I don't know what TempStatsStore is, but derby.log is an artifact of using the default metastore db, derby.  I was unable to figure out a way to get derby.log to not be created or to be created in a particular directory.  I also never saw anything useful in that file.  I delete it whenever I see it.

What's in TempStatsStore?

Pat

From: wd [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Tuesday, May 10, 2011 3:07 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: What does 'TempStatsStore' do ?

hi,

After upgrade to hive 0.7, I found there will a file named 'derby.log' and directory named 'TempStatsStore'  be created every time I run the hive job . What does these files do? Is there a way to prevent them created ?