|
wd
2012-05-31, 07:19
Bhavesh Shah
2012-05-31, 07:23
Bhavesh Shah
2012-05-31, 07:26
wd
2012-05-31, 07:33
Aniket Mokashi
2012-05-31, 07:34
wd
2012-05-31, 07:41
Aniket Mokashi
2012-05-31, 07:48
wd
2012-05-31, 07:56
wd
2012-05-31, 08:31
Malcolm Tye
2012-05-31, 09:16
wd
2012-05-31, 09:37
|
-
Hive partition problemwd 2012-05-31, 07:19
hi,
We setup a new hive 0.9 client, Found some sql did not work, for example hive> create table t1(a int) partitioned by ( dt int ); OK Time taken: 0.097 seconds hive> load data local inpath '/tmp/t' into table t1 partition (dt=111); Copying data from file:/tmp/t Copying file: file:/tmp/t Loading data to table default.t1 partition (dt=111) OK Time taken: 0.375 seconds hive> show partitions t1; OK dt=111 Time taken: 0.108 seconds hive> alter table t1 drop partition ( dt=111 ); FAILED: Error in semantic analysis: Partition not found dt = 111 hive> alter table t1 drop partition ( dt='111' ); FAILED: Error in semantic analysis: Partition not found dt = '111' So, how to delete the partition? +
wd 2012-05-31, 07:19
-
Re: Hive partition problemBhavesh Shah 2012-05-31, 07:23
Hello wd,
Try this one... I am not sure about this ALTER TABLE t1 DROP PARTITION(dt = '111') -- Regards, Bhavesh Shah On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: > hi, > > We setup a new hive 0.9 client, Found some sql did not work, for example > > hive> create table t1(a int) partitioned by ( dt int ); > OK > Time taken: 0.097 seconds > hive> load data local inpath '/tmp/t' into table t1 partition (dt=111); > Copying data from file:/tmp/t > Copying file: file:/tmp/t > Loading data to table default.t1 partition (dt=111) > OK > Time taken: 0.375 seconds > hive> show partitions t1; > OK > dt=111 > Time taken: 0.108 seconds > hive> alter table t1 drop partition ( dt=111 ); > FAILED: Error in semantic analysis: Partition not found dt = 111 > hive> alter table t1 drop partition ( dt='111' ); > FAILED: Error in semantic analysis: Partition not found dt = '111' > > > So, how to delete the partition? > +
Bhavesh Shah 2012-05-31, 07:23
-
Re: Hive partition problemBhavesh Shah 2012-05-31, 07:26
Sorry for previous reply. Actually you had try that one, I didn't saw that.
Really Sorry. On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah <[EMAIL PROTECTED]>wrote: > Hello wd, > Try this one... I am not sure about this > ALTER TABLE t1 DROP PARTITION(dt = '111') > > > -- > Regards, > Bhavesh Shah > > > On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: > >> hi, >> >> We setup a new hive 0.9 client, Found some sql did not work, for example >> >> hive> create table t1(a int) partitioned by ( dt int ); >> OK >> Time taken: 0.097 seconds >> hive> load data local inpath '/tmp/t' into table t1 partition (dt=111); >> Copying data from file:/tmp/t >> Copying file: file:/tmp/t >> Loading data to table default.t1 partition (dt=111) >> OK >> Time taken: 0.375 seconds >> hive> show partitions t1; >> OK >> dt=111 >> Time taken: 0.108 seconds >> hive> alter table t1 drop partition ( dt=111 ); >> FAILED: Error in semantic analysis: Partition not found dt = 111 >> hive> alter table t1 drop partition ( dt='111' ); >> FAILED: Error in semantic analysis: Partition not found dt = '111' >> >> >> So, how to delete the partition? >> > > > > > -- Regards, Bhavesh Shah +
Bhavesh Shah 2012-05-31, 07:26
-
Re: Hive partition problemwd 2012-05-31, 07:33
No problem, thanks for your reply.
I'm very curious why this didn't work, this sql come from hive wiki. The metadata is store in postgres, does it matter? On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> wrote: > Sorry for previous reply. Actually you had try that one, I didn't saw that. > Really Sorry. > > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah <[EMAIL PROTECTED]> > wrote: >> >> Hello wd, >> Try this one... I am not sure about this >> ALTER TABLE t1 DROP PARTITION(dt = '111') >> >> >> -- >> Regards, >> Bhavesh Shah >> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >>> >>> hi, >>> >>> We setup a new hive 0.9 client, Found some sql did not work, for example >>> >>> hive> create table t1(a int) partitioned by ( dt int ); >>> OK >>> Time taken: 0.097 seconds >>> hive> load data local inpath '/tmp/t' into table t1 partition (dt=111); >>> Copying data from file:/tmp/t >>> Copying file: file:/tmp/t >>> Loading data to table default.t1 partition (dt=111) >>> OK >>> Time taken: 0.375 seconds >>> hive> show partitions t1; >>> OK >>> dt=111 >>> Time taken: 0.108 seconds >>> hive> alter table t1 drop partition ( dt=111 ); >>> FAILED: Error in semantic analysis: Partition not found dt = 111 >>> hive> alter table t1 drop partition ( dt='111' ); >>> FAILED: Error in semantic analysis: Partition not found dt = '111' >>> >>> >>> So, how to delete the partition? >> >> >> >> >> > > > > -- > Regards, > Bhavesh Shah > +
wd 2012-05-31, 07:33
-
Re: Hive partition problemAniket Mokashi 2012-05-31, 07:34
You should look at hive log and find exact exception. That will give you a
hint. On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: > No problem, thanks for your reply. > I'm very curious why this didn't work, this sql come from hive wiki. > The metadata is store in postgres, does it matter? > > On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> > wrote: > > Sorry for previous reply. Actually you had try that one, I didn't saw > that. > > Really Sorry. > > > > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah <[EMAIL PROTECTED]> > > wrote: > >> > >> Hello wd, > >> Try this one... I am not sure about this > >> ALTER TABLE t1 DROP PARTITION(dt = '111') > >> > >> > >> -- > >> Regards, > >> Bhavesh Shah > >> > >> > >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: > >>> > >>> hi, > >>> > >>> We setup a new hive 0.9 client, Found some sql did not work, for > example > >>> > >>> hive> create table t1(a int) partitioned by ( dt int ); > >>> OK > >>> Time taken: 0.097 seconds > >>> hive> load data local inpath '/tmp/t' into table t1 partition (dt=111); > >>> Copying data from file:/tmp/t > >>> Copying file: file:/tmp/t > >>> Loading data to table default.t1 partition (dt=111) > >>> OK > >>> Time taken: 0.375 seconds > >>> hive> show partitions t1; > >>> OK > >>> dt=111 > >>> Time taken: 0.108 seconds > >>> hive> alter table t1 drop partition ( dt=111 ); > >>> FAILED: Error in semantic analysis: Partition not found dt = 111 > >>> hive> alter table t1 drop partition ( dt='111' ); > >>> FAILED: Error in semantic analysis: Partition not found dt = '111' > >>> > >>> > >>> So, how to delete the partition? > >> > >> > >> > >> > >> > > > > > > > > -- > > Regards, > > Bhavesh Shah > > > -- "...:::Aniket:::... Quetzalco@tl" +
Aniket Mokashi 2012-05-31, 07:34
-
Re: Hive partition problemwd 2012-05-31, 07:41
Nothing output in hive history file, is there an other log file or an
option to output detail log ? On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi <[EMAIL PROTECTED]> wrote: > You should look at hive log and find exact exception. That will give you a > hint. > > > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: >> >> No problem, thanks for your reply. >> I'm very curious why this didn't work, this sql come from hive wiki. >> The metadata is store in postgres, does it matter? >> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> >> wrote: >> > Sorry for previous reply. Actually you had try that one, I didn't saw >> > that. >> > Really Sorry. >> > >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah <[EMAIL PROTECTED]> >> > wrote: >> >> >> >> Hello wd, >> >> Try this one... I am not sure about this >> >> ALTER TABLE t1 DROP PARTITION(dt = '111') >> >> >> >> >> >> -- >> >> Regards, >> >> Bhavesh Shah >> >> >> >> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >> >>> >> >>> hi, >> >>> >> >>> We setup a new hive 0.9 client, Found some sql did not work, for >> >>> example >> >>> >> >>> hive> create table t1(a int) partitioned by ( dt int ); >> >>> OK >> >>> Time taken: 0.097 seconds >> >>> hive> load data local inpath '/tmp/t' into table t1 partition >> >>> (dt=111); >> >>> Copying data from file:/tmp/t >> >>> Copying file: file:/tmp/t >> >>> Loading data to table default.t1 partition (dt=111) >> >>> OK >> >>> Time taken: 0.375 seconds >> >>> hive> show partitions t1; >> >>> OK >> >>> dt=111 >> >>> Time taken: 0.108 seconds >> >>> hive> alter table t1 drop partition ( dt=111 ); >> >>> FAILED: Error in semantic analysis: Partition not found dt = 111 >> >>> hive> alter table t1 drop partition ( dt='111' ); >> >>> FAILED: Error in semantic analysis: Partition not found dt = '111' >> >>> >> >>> >> >>> So, how to delete the partition? >> >> >> >> >> >> >> >> >> >> >> > >> > >> > >> > -- >> > Regards, >> > Bhavesh Shah >> > > > > > > -- > "...:::Aniket:::... Quetzalco@tl" +
wd 2012-05-31, 07:41
-
Re: Hive partition problemAniket Mokashi 2012-05-31, 07:48
-hiveconf hive.root.logger=DEBUG,FA \
-hiveconf hive.log.dir="$logDir" \ -hiveconf hive.log.file="$logFile" \ On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote: > Nothing output in hive history file, is there an other log file or an > option to output detail log ? > > On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi <[EMAIL PROTECTED]> > wrote: > > You should look at hive log and find exact exception. That will give you > a > > hint. > > > > > > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: > >> > >> No problem, thanks for your reply. > >> I'm very curious why this didn't work, this sql come from hive wiki. > >> The metadata is store in postgres, does it matter? > >> > >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> > >> wrote: > >> > Sorry for previous reply. Actually you had try that one, I didn't saw > >> > that. > >> > Really Sorry. > >> > > >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah < > [EMAIL PROTECTED]> > >> > wrote: > >> >> > >> >> Hello wd, > >> >> Try this one... I am not sure about this > >> >> ALTER TABLE t1 DROP PARTITION(dt = '111') > >> >> > >> >> > >> >> -- > >> >> Regards, > >> >> Bhavesh Shah > >> >> > >> >> > >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: > >> >>> > >> >>> hi, > >> >>> > >> >>> We setup a new hive 0.9 client, Found some sql did not work, for > >> >>> example > >> >>> > >> >>> hive> create table t1(a int) partitioned by ( dt int ); > >> >>> OK > >> >>> Time taken: 0.097 seconds > >> >>> hive> load data local inpath '/tmp/t' into table t1 partition > >> >>> (dt=111); > >> >>> Copying data from file:/tmp/t > >> >>> Copying file: file:/tmp/t > >> >>> Loading data to table default.t1 partition (dt=111) > >> >>> OK > >> >>> Time taken: 0.375 seconds > >> >>> hive> show partitions t1; > >> >>> OK > >> >>> dt=111 > >> >>> Time taken: 0.108 seconds > >> >>> hive> alter table t1 drop partition ( dt=111 ); > >> >>> FAILED: Error in semantic analysis: Partition not found dt = 111 > >> >>> hive> alter table t1 drop partition ( dt='111' ); > >> >>> FAILED: Error in semantic analysis: Partition not found dt = '111' > >> >>> > >> >>> > >> >>> So, how to delete the partition? > >> >> > >> >> > >> >> > >> >> > >> >> > >> > > >> > > >> > > >> > -- > >> > Regards, > >> > Bhavesh Shah > >> > > > > > > > > > > > -- > > "...:::Aniket:::... Quetzalco@tl" > -- "...:::Aniket:::... Quetzalco@tl" +
Aniket Mokashi 2012-05-31, 07:48
-
Re: Hive partition problemwd 2012-05-31, 07:56
Still no useful output. But we found the problem.
When the partition col type is int, it can't be droped. After change it to string, it can be droped. On Thu, May 31, 2012 at 3:48 PM, Aniket Mokashi <[EMAIL PROTECTED]> wrote: > -hiveconf hive.root.logger=DEBUG,FA \ > -hiveconf hive.log.dir="$logDir" \ > -hiveconf hive.log.file="$logFile" \ > > On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote: >> >> Nothing output in hive history file, is there an other log file or an >> option to output detail log ? >> >> On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi <[EMAIL PROTECTED]> >> wrote: >> > You should look at hive log and find exact exception. That will give you >> > a >> > hint. >> > >> > >> > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: >> >> >> >> No problem, thanks for your reply. >> >> I'm very curious why this didn't work, this sql come from hive wiki. >> >> The metadata is store in postgres, does it matter? >> >> >> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> >> >> wrote: >> >> > Sorry for previous reply. Actually you had try that one, I didn't saw >> >> > that. >> >> > Really Sorry. >> >> > >> >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah >> >> > <[EMAIL PROTECTED]> >> >> > wrote: >> >> >> >> >> >> Hello wd, >> >> >> Try this one... I am not sure about this >> >> >> ALTER TABLE t1 DROP PARTITION(dt = '111') >> >> >> >> >> >> >> >> >> -- >> >> >> Regards, >> >> >> Bhavesh Shah >> >> >> >> >> >> >> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >> >> >>> >> >> >>> hi, >> >> >>> >> >> >>> We setup a new hive 0.9 client, Found some sql did not work, for >> >> >>> example >> >> >>> >> >> >>> hive> create table t1(a int) partitioned by ( dt int ); >> >> >>> OK >> >> >>> Time taken: 0.097 seconds >> >> >>> hive> load data local inpath '/tmp/t' into table t1 partition >> >> >>> (dt=111); >> >> >>> Copying data from file:/tmp/t >> >> >>> Copying file: file:/tmp/t >> >> >>> Loading data to table default.t1 partition (dt=111) >> >> >>> OK >> >> >>> Time taken: 0.375 seconds >> >> >>> hive> show partitions t1; >> >> >>> OK >> >> >>> dt=111 >> >> >>> Time taken: 0.108 seconds >> >> >>> hive> alter table t1 drop partition ( dt=111 ); >> >> >>> FAILED: Error in semantic analysis: Partition not found dt = 111 >> >> >>> hive> alter table t1 drop partition ( dt='111' ); >> >> >>> FAILED: Error in semantic analysis: Partition not found dt = '111' >> >> >>> >> >> >>> >> >> >>> So, how to delete the partition? >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > >> >> > >> >> > >> >> > -- >> >> > Regards, >> >> > Bhavesh Shah >> >> > >> > >> > >> > >> > >> > -- >> > "...:::Aniket:::... Quetzalco@tl" > > > > > -- > "...:::Aniket:::... Quetzalco@tl" +
wd 2012-05-31, 07:56
-
Re: Hive partition problemwd 2012-05-31, 08:31
Is this a bug? Should I report a bug to hive?
On Thu, May 31, 2012 at 3:56 PM, wd <[EMAIL PROTECTED]> wrote: > Still no useful output. But we found the problem. > > When the partition col type is int, it can't be droped. After change > it to string, it can be droped. > > On Thu, May 31, 2012 at 3:48 PM, Aniket Mokashi <[EMAIL PROTECTED]> wrote: >> -hiveconf hive.root.logger=DEBUG,FA \ >> -hiveconf hive.log.dir="$logDir" \ >> -hiveconf hive.log.file="$logFile" \ >> >> On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote: >>> >>> Nothing output in hive history file, is there an other log file or an >>> option to output detail log ? >>> >>> On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi <[EMAIL PROTECTED]> >>> wrote: >>> > You should look at hive log and find exact exception. That will give you >>> > a >>> > hint. >>> > >>> > >>> > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: >>> >> >>> >> No problem, thanks for your reply. >>> >> I'm very curious why this didn't work, this sql come from hive wiki. >>> >> The metadata is store in postgres, does it matter? >>> >> >>> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah <[EMAIL PROTECTED]> >>> >> wrote: >>> >> > Sorry for previous reply. Actually you had try that one, I didn't saw >>> >> > that. >>> >> > Really Sorry. >>> >> > >>> >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah >>> >> > <[EMAIL PROTECTED]> >>> >> > wrote: >>> >> >> >>> >> >> Hello wd, >>> >> >> Try this one... I am not sure about this >>> >> >> ALTER TABLE t1 DROP PARTITION(dt = '111') >>> >> >> >>> >> >> >>> >> >> -- >>> >> >> Regards, >>> >> >> Bhavesh Shah >>> >> >> >>> >> >> >>> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >>> >> >>> >>> >> >>> hi, >>> >> >>> >>> >> >>> We setup a new hive 0.9 client, Found some sql did not work, for >>> >> >>> example >>> >> >>> >>> >> >>> hive> create table t1(a int) partitioned by ( dt int ); >>> >> >>> OK >>> >> >>> Time taken: 0.097 seconds >>> >> >>> hive> load data local inpath '/tmp/t' into table t1 partition >>> >> >>> (dt=111); >>> >> >>> Copying data from file:/tmp/t >>> >> >>> Copying file: file:/tmp/t >>> >> >>> Loading data to table default.t1 partition (dt=111) >>> >> >>> OK >>> >> >>> Time taken: 0.375 seconds >>> >> >>> hive> show partitions t1; >>> >> >>> OK >>> >> >>> dt=111 >>> >> >>> Time taken: 0.108 seconds >>> >> >>> hive> alter table t1 drop partition ( dt=111 ); >>> >> >>> FAILED: Error in semantic analysis: Partition not found dt = 111 >>> >> >>> hive> alter table t1 drop partition ( dt='111' ); >>> >> >>> FAILED: Error in semantic analysis: Partition not found dt = '111' >>> >> >>> >>> >> >>> >>> >> >>> So, how to delete the partition? >>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> >> > >>> >> > >>> >> > >>> >> > -- >>> >> > Regards, >>> >> > Bhavesh Shah >>> >> > >>> > >>> > >>> > >>> > >>> > -- >>> > "...:::Aniket:::... Quetzalco@tl" >> >> >> >> >> -- >> "...:::Aniket:::... Quetzalco@tl" +
wd 2012-05-31, 08:31
-
RE: Hive partition problemMalcolm Tye 2012-05-31, 09:16
Hi,
We used to use integer partitioning for 2 columns, "year_month_day" and "hour" When it came to dropping 1 partition for an hour for a particular day, it seemed to drop all of the hour partitions for the day. IMO it's a bug. We just moved to using text Malc -----Original Message----- From: wd [mailto:[EMAIL PROTECTED]] Sent: 31 May 2012 09:32 To: [EMAIL PROTECTED] Subject: Re: Hive partition problem Is this a bug? Should I report a bug to hive? On Thu, May 31, 2012 at 3:56 PM, wd <[EMAIL PROTECTED]> wrote: > Still no useful output. But we found the problem. > > When the partition col type is int, it can't be droped. After change > it to string, it can be droped. > > On Thu, May 31, 2012 at 3:48 PM, Aniket Mokashi <[EMAIL PROTECTED]> wrote: >> -hiveconf hive.root.logger=DEBUG,FA \ >> -hiveconf hive.log.dir="$logDir" \ >> -hiveconf hive.log.file="$logFile" \ >> >> On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote: >>> >>> Nothing output in hive history file, is there an other log file or >>> an option to output detail log ? >>> >>> On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi >>> <[EMAIL PROTECTED]> >>> wrote: >>> > You should look at hive log and find exact exception. That will >>> > give you a hint. >>> > >>> > >>> > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: >>> >> >>> >> No problem, thanks for your reply. >>> >> I'm very curious why this didn't work, this sql come from hive wiki. >>> >> The metadata is store in postgres, does it matter? >>> >> >>> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah >>> >> <[EMAIL PROTECTED]> >>> >> wrote: >>> >> > Sorry for previous reply. Actually you had try that one, I >>> >> > didn't saw that. >>> >> > Really Sorry. >>> >> > >>> >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah >>> >> > <[EMAIL PROTECTED]> >>> >> > wrote: >>> >> >> >>> >> >> Hello wd, >>> >> >> Try this one... I am not sure about this ALTER TABLE t1 DROP >>> >> >> PARTITION(dt = '111') >>> >> >> >>> >> >> >>> >> >> -- >>> >> >> Regards, >>> >> >> Bhavesh Shah >>> >> >> >>> >> >> >>> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >>> >> >>> >>> >> >>> hi, >>> >> >>> >>> >> >>> We setup a new hive 0.9 client, Found some sql did not work, >>> >> >>> for example >>> >> >>> >>> >> >>> hive> create table t1(a int) partitioned by ( dt int ); >>> >> >>> OK >>> >> >>> Time taken: 0.097 seconds >>> >> >>> hive> load data local inpath '/tmp/t' into table t1 partition >>> >> >>> (dt=111); >>> >> >>> Copying data from file:/tmp/t Copying file: file:/tmp/t >>> >> >>> Loading data to table default.t1 partition (dt=111) OK Time >>> >> >>> taken: 0.375 seconds >>> >> >>> hive> show partitions t1; >>> >> >>> OK >>> >> >>> dt=111 >>> >> >>> Time taken: 0.108 seconds >>> >> >>> hive> alter table t1 drop partition ( dt=111 ); >>> >> >>> FAILED: Error in semantic analysis: Partition not found dt = >>> >> >>> 111 >>> >> >>> hive> alter table t1 drop partition ( dt='111' ); >>> >> >>> FAILED: Error in semantic analysis: Partition not found dt '111' >>> >> >>> >>> >> >>> >>> >> >>> So, how to delete the partition? >>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> >> > >>> >> > >>> >> > >>> >> > -- >>> >> > Regards, >>> >> > Bhavesh Shah >>> >> > >>> > >>> > >>> > >>> > >>> > -- >>> > "...:::Aniket:::... Quetzalco@tl" >> >> >> >> >> -- >> "...:::Aniket:::... Quetzalco@tl" +
Malcolm Tye 2012-05-31, 09:16
-
Re: Hive partition problemwd 2012-05-31, 09:37
It's too bad.
I've file a issue at hive jira, https://issues.apache.org/jira/browse/HIVE-3069. On Thu, May 31, 2012 at 5:16 PM, Malcolm Tye <[EMAIL PROTECTED]> wrote: > Hi, > We used to use integer partitioning for 2 columns, "year_month_day" > and "hour" > > When it came to dropping 1 partition for an hour for a particular day, it > seemed to drop all of the hour partitions for the day. > > IMO it's a bug. We just moved to using text > > > Malc > > > -----Original Message----- > From: wd [mailto:[EMAIL PROTECTED]] > Sent: 31 May 2012 09:32 > To: [EMAIL PROTECTED] > Subject: Re: Hive partition problem > > Is this a bug? Should I report a bug to hive? > > On Thu, May 31, 2012 at 3:56 PM, wd <[EMAIL PROTECTED]> wrote: >> Still no useful output. But we found the problem. >> >> When the partition col type is int, it can't be droped. After change >> it to string, it can be droped. >> >> On Thu, May 31, 2012 at 3:48 PM, Aniket Mokashi <[EMAIL PROTECTED]> > wrote: >>> -hiveconf hive.root.logger=DEBUG,FA \ >>> -hiveconf hive.log.dir="$logDir" \ >>> -hiveconf hive.log.file="$logFile" \ >>> >>> On Thu, May 31, 2012 at 12:41 AM, wd <[EMAIL PROTECTED]> wrote: >>>> >>>> Nothing output in hive history file, is there an other log file or >>>> an option to output detail log ? >>>> >>>> On Thu, May 31, 2012 at 3:34 PM, Aniket Mokashi >>>> <[EMAIL PROTECTED]> >>>> wrote: >>>> > You should look at hive log and find exact exception. That will >>>> > give you a hint. >>>> > >>>> > >>>> > On Thu, May 31, 2012 at 12:33 AM, wd <[EMAIL PROTECTED]> wrote: >>>> >> >>>> >> No problem, thanks for your reply. >>>> >> I'm very curious why this didn't work, this sql come from hive wiki. >>>> >> The metadata is store in postgres, does it matter? >>>> >> >>>> >> On Thu, May 31, 2012 at 3:26 PM, Bhavesh Shah >>>> >> <[EMAIL PROTECTED]> >>>> >> wrote: >>>> >> > Sorry for previous reply. Actually you had try that one, I >>>> >> > didn't saw that. >>>> >> > Really Sorry. >>>> >> > >>>> >> > On Thu, May 31, 2012 at 12:53 PM, Bhavesh Shah >>>> >> > <[EMAIL PROTECTED]> >>>> >> > wrote: >>>> >> >> >>>> >> >> Hello wd, >>>> >> >> Try this one... I am not sure about this ALTER TABLE t1 DROP >>>> >> >> PARTITION(dt = '111') >>>> >> >> >>>> >> >> >>>> >> >> -- >>>> >> >> Regards, >>>> >> >> Bhavesh Shah >>>> >> >> >>>> >> >> >>>> >> >> On Thu, May 31, 2012 at 12:49 PM, wd <[EMAIL PROTECTED]> wrote: >>>> >> >>> >>>> >> >>> hi, >>>> >> >>> >>>> >> >>> We setup a new hive 0.9 client, Found some sql did not work, >>>> >> >>> for example >>>> >> >>> >>>> >> >>> hive> create table t1(a int) partitioned by ( dt int ); >>>> >> >>> OK >>>> >> >>> Time taken: 0.097 seconds >>>> >> >>> hive> load data local inpath '/tmp/t' into table t1 partition >>>> >> >>> (dt=111); >>>> >> >>> Copying data from file:/tmp/t Copying file: file:/tmp/t >>>> >> >>> Loading data to table default.t1 partition (dt=111) OK Time >>>> >> >>> taken: 0.375 seconds >>>> >> >>> hive> show partitions t1; >>>> >> >>> OK >>>> >> >>> dt=111 >>>> >> >>> Time taken: 0.108 seconds >>>> >> >>> hive> alter table t1 drop partition ( dt=111 ); >>>> >> >>> FAILED: Error in semantic analysis: Partition not found dt >>>> >> >>> 111 >>>> >> >>> hive> alter table t1 drop partition ( dt='111' ); >>>> >> >>> FAILED: Error in semantic analysis: Partition not found dt > '111' >>>> >> >>> >>>> >> >>> >>>> >> >>> So, how to delete the partition? >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> >> >>>> >> > >>>> >> > >>>> >> > >>>> >> > -- >>>> >> > Regards, >>>> >> > Bhavesh Shah >>>> >> > >>>> > >>>> > >>>> > >>>> > >>>> > -- >>>> > "...:::Aniket:::... Quetzalco@tl" >>> >>> >>> >>> >>> -- >>> "...:::Aniket:::... Quetzalco@tl" > +
wd 2012-05-31, 09:37
|