Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Partitions in pig


Copy link to this message
-
Re: Partitions in pig
To be clear, the next CDH release is going to include HCatalog.

Thanks,
Cheolsoo
On Tue, Dec 18, 2012 at 3:13 PM, Russell Jurney <[EMAIL PROTECTED]>wrote:

> This is what HCatalog and Pig's HCatStorage is for, to access data
> from Hive from Pig. Unfortunately you are running CDH, which doesn't
> support the Apache HCatalog project. HDP includes Apache HCatalog:
> http://hortonworks.com/hdp/hdp-hcatalog-metadata-services/ More info
> on Apache HCatalog is available here:
> http://www.infoq.com/articles/HadoopMetadata
>
> However, there is an RCFile loader in Piggybank:
>
> http://svn.apache.org/viewvc/pig/trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/HiveColumnarLoader.java?view=markup
>
> Russell Jurney http://datasyndrome.com
>
> On Dec 18, 2012, at 2:39 PM, abhishek <[EMAIL PROTECTED]> wrote:
>
> > Hi all,
> >
> > I have a use case which is implemented in hive with partitions.
> >
> > Say
> > Customer_data/2012-12-18/....
> >                        /2012-12-17/....
> >                        /2012-12-16/....
> >                        /
> >                        /
> >
> > I want implement this in pig.
> >
> > How will partitions work in pig?
> >
> > Regards
> > Abhishek
>