All,
  Would it make sense to change the default configuration to set
hive.enforce.bucketing and hive.exec.dynamic.partition to true? I find
that I usually change them and I wonder what other peoples' experience
with them is.

Thoughts?
  Owen

I agree with changing the hive.exec.dynamic.partitions.
I am not sure about enforcing hive.enforcing.bucketing. It can have a
additional
cost, which may or may not be needed. If we change this, we should trust
the metastore
completelely and also change hive.optimize.bucketmapjoin and
hive.optimize.bucketmapjoin.sortedmerge to true.

This may break some legacy applications, but it may completely make sense
for new setups.
Thanks,
-namit
On 3/2/12 8:45 AM, "Owen O'Malley" <[EMAIL PROTECTED]> wrote:

>All,
>  Would it make sense to change the default configuration to set
>hive.enforce.bucketing and hive.exec.dynamic.partition to true? I find
>that I usually change them and I wonder what other peoples' experience
>with them is.
>
>Thoughts?
>  Owen

I am also in favor of setting hive.exec.dynamic.partition to true.

-----Original Message-----
From: Namit Jain [mailto:[EMAIL PROTECTED]]
Sent: Friday, March 02, 2012 9:03 AM
To: [EMAIL PROTECTED]
Subject: Re: Changing defaults for dynamic partitioning and enforced bucketing?

I agree with changing the hive.exec.dynamic.partitions.
I am not sure about enforcing hive.enforcing.bucketing. It can have a additional cost, which may or may not be needed. If we change this, we should trust the metastore completelely and also change hive.optimize.bucketmapjoin and hive.optimize.bucketmapjoin.sortedmerge to true.

This may break some legacy applications, but it may completely make sense for new setups.
Thanks,
-namit
On 3/2/12 8:45 AM, "Owen O'Malley" <[EMAIL PROTECTED]> wrote:

>All,
>  Would it make sense to change the default configuration to set
>hive.enforce.bucketing and hive.exec.dynamic.partition to true? I find
>that I usually change them and I wonder what other peoples' experience
>with them is.
>
>Thoughts?
>  Owen