Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Writing to rcfile

Copy link to this message
Re: Writing to rcfile
Elephantbird has support RCFile storage. current version supports storing
Thrift and Protobufs.

You can try prototype implementation
it can be used in place of PigStorage(). This is not yet committed, will
likely be included in next release (

usage :
  register 'libs/*hive-common*.jar; -- hive-common for RCFile
  register 'libs/*hive-exec*.jar;  -- hive-exec for RCFile
  register 'libs/*protobuf-java*.jar; -- protobuf-java should not be
required, but for now it is.

  a = load 'x.txt' as (a, b);
  store a into 'output' using RCFilePigStorage();

On Tue, May 22, 2012 at 2:14 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:

> Could someone please point me to someway where I can store in rcfile format
> with snappy compression? I need to use this output in hive.