Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - Hive partition problem


Copy link to this message
-
Re: Hive partition problem
wd 2012-05-31, 09:37
It's too bad.
I've file a issue at hive jira, https://issues.apache.org/jira/browse/HIVE-3069.

On Thu, May 31, 2012 at 5:16 PM, Malcolm Tye <[EMAIL PROTECTED]> wrote:
> Hi,
>        We used to use integer partitioning for 2 columns, "year_month_day"
> and "hour"
>
> When it came to dropping 1 partition for an hour for a particular day, it
> seemed to drop all of the hour partitions for the day.
>
> IMO it's a bug. We just moved to using text
>
>
> Malc
>
>
> -----Original Message-----
> From: wd [mailto:[EMAIL PROTECTED]]
> Sent: 31 May 2012 09:32
> To: [EMAIL PROTECTED]
> Subject: Re: Hive partition problem
>
> Is this a bug? Should I report a bug to hive?
>
> On Thu, May 31, 2012 at 3:56 PM, wd <[EMAIL PROTECTED]> wrote:
>> Still no useful output. But we found the problem.
>>
>> When the partition col type is int, it can't be droped. After change
>> it to string, it can be droped.
>>
>> On Thu, May 31, 2012 at 3:48 PM, Aniket Mokashi <[EMAIL PROTECTED]>
> wrote:
>>> -hiveconf hive.root.logger=DEBUG,FA \
>>>     -hiveconf hive.log.dir="$logDir" \
>>>     -hiveconf hive.log.file="$logFile" \
>>>
>>> On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote:
>>>>
>>>> Nothing output in hive history file, is there an other log file or
>>>> an option to output detail log ?
>>>>
>>>> On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi
>>>> <[EMAIL PROTECTED]>
>>>> wrote:
>>>> > You should look at hive log and find exact exception. That will
>>>> > give you a hint.
>>>> >
>>>> >
>>>> > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote:
>>>> >>
>>>> >> No problem, thanks for your reply.
>>>> >> I'm very curious why this didn't work, this sql come from hive wiki.
>>>> >> The metadata is store in postgres, does it matter?
>>>> >>
>>>> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah
>>>> >> <[EMAIL PROTECTED]>
>>>> >> wrote:
>>>> >> > Sorry for previous reply. Actually you had try that one, I
>>>> >> > didn't saw that.
>>>> >> > Really Sorry.
>>>> >> >
>>>> >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah
>>>> >> > <[EMAIL PROTECTED]>
>>>> >> > wrote:
>>>> >> >>
>>>> >> >> Hello wd,
>>>> >> >> Try this one... I am not sure about this ALTER TABLE t1 DROP
>>>> >> >> PARTITION(dt = '111')
>>>> >> >>
>>>> >> >>
>>>> >> >> --
>>>> >> >> Regards,
>>>> >> >> Bhavesh Shah
>>>> >> >>
>>>> >> >>
>>>> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote:
>>>> >> >>>
>>>> >> >>> hi,
>>>> >> >>>
>>>> >> >>> We setup a new hive 0.9 client, Found some sql did not work,
>>>> >> >>> for example
>>>> >> >>>
>>>> >> >>> hive> create table t1(a int) partitioned by ( dt int );
>>>> >> >>> OK
>>>> >> >>> Time taken: 0.097 seconds
>>>> >> >>> hive> load data local inpath '/tmp/t' into table t1 partition
>>>> >> >>> (dt=111);
>>>> >> >>> Copying data from file:/tmp/t Copying file: file:/tmp/t
>>>> >> >>> Loading data to table default.t1 partition (dt=111) OK Time
>>>> >> >>> taken: 0.375 seconds
>>>> >> >>> hive> show partitions t1;
>>>> >> >>> OK
>>>> >> >>> dt=111
>>>> >> >>> Time taken: 0.108 seconds
>>>> >> >>> hive> alter table t1 drop partition ( dt=111 );
>>>> >> >>> FAILED: Error in semantic analysis: Partition not found dt >>>> >> >>> 111
>>>> >> >>> hive> alter table t1 drop partition ( dt='111' );
>>>> >> >>> FAILED: Error in semantic analysis: Partition not found dt > '111'
>>>> >> >>>
>>>> >> >>>
>>>> >> >>> So, how to delete the partition?
>>>> >> >>
>>>> >> >>
>>>> >> >>
>>>> >> >>
>>>> >> >>
>>>> >> >
>>>> >> >
>>>> >> >
>>>> >> > --
>>>> >> > Regards,
>>>> >> > Bhavesh Shah
>>>> >> >
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > "...:::Aniket:::... Quetzalco@tl"
>>>
>>>
>>>
>>>
>>> --
>>> "...:::Aniket:::... Quetzalco@tl"
>