Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Extending pipes to support binary data

Copy link to this message
Extending pipes to support binary data
Charles Earl 2012-02-15, 04:16
I'm trying to extend the pipes interface as defined in Pipes.hh to
support the read of binary input data.
I believe that would mean extending the getInputValue() method of
context to return char *, which would then be memcpy'd to appropriate
type inside the C++ pipes program.
I'm guessing the best way  to do this would be to use a custom
InputFormat on the java side that would have BytesWritable value.
Is this the correct approach?

- Charles