Elephantbird has support RCFile storage. current version supports storing
Thrift and Protobufs.
You can try prototype implementation
it can be used in place of PigStorage(). This is not yet committed, will
likely be included in next release (
register 'libs/*hive-common*.jar; -- hive-common for RCFile
register 'libs/*hive-exec*.jar; -- hive-exec for RCFile
register 'libs/*protobuf-java*.jar; -- protobuf-java should not be
required, but for now it is.
a = load 'x.txt' as (a, b);
store a into 'output' using RCFilePigStorage();
On Tue, May 22, 2012 at 2:14 PM, Mohit Anchlia <[EMAIL PROTECTED]>wrote:
> Could someone please point me to someway where I can store in rcfile format
> with snappy compression? I need to use this output in hive.