Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - protobuf without LZO in elephant-bird

Copy link to this message
Re: protobuf without LZO in elephant-bird
Raghu Angadi 2011-09-23, 20:43
What format is the file in?

You can use ProtobufBytesToTuple() udf to convert protobuf bytes to a PIG


ToTuple com.twitter.elephantbird.pig.piggybank.ProtobufBytesToTuple('com.example.protobufs.Table.User');

users = foreach binary generate ToTuple(user_bytes);
describe users;


On Thu, Sep 22, 2011 at 9:27 PM, Doug Daniels <[EMAIL PROTECTED]>wrote:

> Is it possible to use elephant-bird to load protobuf-encoded data that
> isn't compressed with LZO?
> Thanks,
> Doug