Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Partitions on hive hbase table


Copy link to this message
-
Re: Partitions on hive hbase table
Thanks bharath.

Do you have an example of what such query would look like?

Thanks,

On Mon, Oct 15, 2012 at 11:48 AM, bharath vissapragada <
[EMAIL PROTECTED]> wrote:

>
> I'm not sure about partitioning but the scans are currently limited based
> on start and stop keys ( if predicates on rowkeys are provided in the query)
>
> See Hive-1643 ,2815 jiras !
>
> On Mon, Oct 15, 2012 at 10:09 PM, [EMAIL PROTECTED] <
> [EMAIL PROTECTED]> wrote:
>
>> All,
>>
>> So, I have an external table in hive backed by a huge hbase table. I was
>> wondering what are the best practices to partition my data so that my
>> queries do not have to do a full-table scan always?
>>
>> A quick research on this yielded some ways where the partition would need
>> to be created and then data loaded into these partitions. Or to use dynamic
>> partitions.
>>
>> Is there any way to limit the scans based on the start and stop keys?
>> Also, if I decide to go with dynamic partitions, how do I keep the data up
>> to date in my partitioned tables?
>>
>> Thanks for any help.
>>
>> --
>> Swarnim
>>
>> --
>> Regards,
>> Bharath .V
>> w:http://researchweb.iiit.ac.in/~bharath.v
>>
>>
--
Swarnim