Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Help with kafka-hadoop loader pipeline ???

Copy link to this message
Help with kafka-hadoop loader pipeline ???

We were trying to use the kafka-hadoop loader for loading messages from
kafka into the hadoop ecosystem

Our consumer is hadoop in this case. The code runs saying job successfull
and a _SUCESS file is created in hdfs.

But no output file is created in the given hdfs path, we tried sending both
json as well as protobuf files through kafka.

Please help if anyone has any idea on loading protobuf files into hadoop.
Chitra Raveendran
Data Scientist
*Flutura Decision Sciences & Analytics*