-Re: Kafka Hadoop Consumer for multiple brokers
Jun Rao 2013-06-04, 15:11
The idea is that each mapper is only connecting to a single Kafka broker.
Each line in the input file specifies broker uri, topic, partition and
The hadoop consumer in contrib is probably a bit outdated. The one that
LinkedIn uses now can be found at https://github.com/linkedin/camus
On Tue, Jun 4, 2013 at 7:29 AM, Samir Madhavan <
[EMAIL PROTECTED]> wrote:
> I was going through the hadoop-consumer in the contrib folder. There is
> property that asks for the kafka server URI. This might sound silly but
> from looking at it, it seems to be only for a single kafka broker.
> What we have multiple brokers, how do we implement the hadoop-consumer for