-Re: Partitions in pig
Russell Jurney 2012-12-19, 00:20
Are you doing a directory-based partition with Hive, or are you
letting Hive's RCFile partition data for you?
Russell Jurney http://datasyndrome.com
On Dec 18, 2012, at 4:12 PM, abhishek <[EMAIL PROTECTED]> wrote:
> Hi Russell,
> Thanks for the reply.How RCFile loader is related to partitions?
> I did not get your point in this.
> Sent from my iPhone
> On Dec 18, 2012, at 6:13 PM, Russell Jurney <[EMAIL PROTECTED]> wrote:
>> This is what HCatalog and Pig's HCatStorage is for, to access data
>> from Hive from Pig. Unfortunately you are running CDH, which doesn't
>> support the Apache HCatalog project. HDP includes Apache HCatalog:
>> http://hortonworks.com/hdp/hdp-hcatalog-metadata-services/ More info
>> on Apache HCatalog is available here:
>> However, there is an RCFile loader in Piggybank:
>> Russell Jurney http://datasyndrome.com
>> On Dec 18, 2012, at 2:39 PM, abhishek <[EMAIL PROTECTED]> wrote:
>>> Hi all,
>>> I have a use case which is implemented in hive with partitions.
>>> I want implement this in pig.
>>> How will partitions work in pig?