Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> protobuf without LZO in elephant-bird


Copy link to this message
-
Re: protobuf without LZO in elephant-bird
What format is the file in?

You can use ProtobufBytesToTuple() udf to convert protobuf bytes to a PIG
tuple.

e.g.:

define
ToTuple com.twitter.elephantbird.pig.piggybank.ProtobufBytesToTuple('com.example.protobufs.Table.User');

users = foreach binary generate ToTuple(user_bytes);
describe users;

Raghu.

On Thu, Sep 22, 2011 at 9:27 PM, Doug Daniels <[EMAIL PROTECTED]>wrote:

> Is it possible to use elephant-bird to load protobuf-encoded data that
> isn't compressed with LZO?
>
> Thanks,
> Doug
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB