Home
|
About
|
Sematext
search-lucene.com
search-hadoop.com
Search Hadoop
and all its subprojects:
Search
Switch to Threaded View
Pig, mail # user - protobuf without LZO in elephant-bird
Doug Daniels
2011-09-23, 04:27
Raghu Angadi
2011-09-23, 20:43
-
protobuf without LZO in elephant-bird
Doug Daniels 2011-09-23, 04:27
Is it possible to use elephant-bird to load protobuf-encoded data that isn't compressed with LZO?
Thanks,
Doug
-
Re: protobuf without LZO in elephant-bird
Raghu Angadi 2011-09-23, 20:43
What format is the file in?
You can use ProtobufBytesToTuple() udf to convert protobuf bytes to a PIG
tuple.
e.g.:
define
ToTuple com.twitter.elephantbird.pig.piggybank.ProtobufBytesToTuple('com.example.protobufs.Table.User');
users = foreach binary generate ToTuple(user_bytes);
describe users;
Raghu.
On Thu, Sep 22, 2011 at 9:27 PM, Doug Daniels <[EMAIL PROTECTED]>wrote:
> Is it possible to use elephant-bird to load protobuf-encoded data that
> isn't compressed with LZO?
>
> Thanks,
> Doug
>
All projects made searchable here are trademarks of the Apache Software Foundation. Service operated by
Sematext