Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> Problem with consumers in a consumers group


+
Javier Iseruk 2013-05-09, 15:51
+
Neha Narkhede 2013-05-09, 16:22
Copy link to this message
-
Re: Problem with consumers in a consumers group
Thanks for the answer. I send you the info:
I am ommiting all the files in each directory, just leaves one for showing
the structure.
There are two topics: access_log@nginx-nginx-api-master and
access_log@nginx-nginx-api-v1.
The consumer uses a whitelist with the regex access_log@nginx-nginx-api-.*,
so both topis are consumed
 I don't see any problem with the topics names.

Broker 0:
/kafka/logs> tree
.
|-- access_log@nginx-nginx-api-master-0
|   `-- 00000000104220676901.kafka
|-- access_log@nginx-nginx-api-master-1
|   `-- 00000001848656795194.kafka
|-- access_log@nginx-nginx-api-master-2
|   `-- 00000000205422337816.kafka
|-- access_log@nginx-nginx-api-master-3
|   `-- 00000000065714271675.kafka
|-- access_log@nginx-nginx-api-master-4
|   `-- 00000002042994150834.kafka
|-- access_log@nginx-nginx-api-master-5
|   `-- 00000003554704806448.kafka
|-- access_log@nginx-nginx-api-master-6
|   `-- 00000005445803344687.kafka
|-- access_log@nginx-nginx-api-master-7
|   `-- 00000003606342657110.kafka
|-- access_log@nginx-nginx-api-master-8
|   `-- 00000002693751681000.kafka
|-- access_log@nginx-nginx-api-master-9
|   `-- 00000001393405947605.kafka
|-- access_log@nginx-nginx-api-v1-0
|   `-- 00000000132598986468.kafka
|-- access_log@nginx-nginx-api-v1-1
|   `-- 00000000137269970386.kafka
|-- access_log@nginx-nginx-api-v1-2
|   `-- 00000000136972308161.kafka
|-- access_log@nginx-nginx-api-v1-3
|   `-- 00000000146486674802.kafka
|-- access_log@nginx-nginx-api-v1-6
|   `-- 00000000009125337012.kafka
|-- access_log@nginx-nginx-api-v1-8
|   `-- 00000000009010149647.kafka

broker 1:
/kafka/logs> tree
.
|-- access_log@nginx-nginx-api-master-0
|   `-- 00000002313153902757.kafka
|-- access_log@nginx-nginx-api-master-1
|   `-- 00000003097259627500.kafka
|-- access_log@nginx-nginx-api-master-2
|   `-- 00000002959536779137.kafka
|-- access_log@nginx-nginx-api-master-3
|   `-- 00000003053863102518.kafka
|-- access_log@nginx-nginx-api-master-4
|   `-- 00000002187535473763.kafka
|-- access_log@nginx-nginx-api-master-5
|   `-- 00000004427181341253.kafka
|-- access_log@nginx-nginx-api-master-6
|   `-- 00000002356845031168.kafka
|-- access_log@nginx-nginx-api-master-7
|   `-- 00000002286128315593.kafka
|-- access_log@nginx-nginx-api-master-8
|   `-- 00000002240322631141.kafka
|-- access_log@nginx-nginx-api-master-9
|   `-- 00000002298179990598.kafka
|-- access_log@nginx-nginx-api-v1-0
|   `-- 00000000000111649340.kafka
|-- access_log@nginx-nginx-api-v1-1
|   `-- 00000000000112654964.kafka
|-- access_log@nginx-nginx-api-v1-2
|   `-- 00000000000110500958.kafka
|-- access_log@nginx-nginx-api-v1-3
|   `-- 00000000000107970659.kafka

broker 2:
/kafka/logs> tree
.
|-- access_log@nginx-nginx-api-master-0
|   `-- 00000001295587955823.kafka
|-- access_log@nginx-nginx-api-master-1
|   `-- 00000001280489056047.kafka
|-- access_log@nginx-nginx-api-master-2
|   `-- 00000000465978408295.kafka
|-- access_log@nginx-nginx-api-master-3
|   `-- 00000000459780591967.kafka
|-- access_log@nginx-nginx-api-master-4
|   `-- 00000000558193144600.kafka
|-- access_log@nginx-nginx-api-master-5
|   `-- 00000000556797739267.kafka
|-- access_log@nginx-nginx-api-master-6
|   `-- 00000000553188940491.kafka
|-- access_log@nginx-nginx-api-master-7
|   `-- 00000000562912390935.kafka
|-- access_log@nginx-nginx-api-master-8
|   `-- 00000000594913040282.kafka
|-- access_log@nginx-nginx-api-master-9
|   `-- 00000000691253299404.kafka
|-- access_log@nginx-nginx-api-v1-0
|   `-- 00000000005593211143.kafka
|-- access_log@nginx-nginx-api-v1-1
|   `-- 00000000005569669640.kafka
|-- access_log@nginx-nginx-api-v1-2
|   `-- 00000000005572829089.kafka
|-- access_log@nginx-nginx-api-v1-3
|   `-- 00000000005598264785.kafka

broker 3:
/kafka/logs> tree
.
|-- access_log@nginx-nginx-api-master-0
|   `-- 00000000000048203157.kafka
|-- access_log@nginx-nginx-api-master-1
|   `-- 00000000000003173076.kaf|-- access_log@nginx-nginx-api-v1-0
|   `-- 00000000000000223076.kafka
|-- access_log@nginx-nginx-api-v1-2
|   `-- 00000000000000135488.kafka

broker 4:
/kafka/logs> tree
.
|-- access_log@nginx-nginx-api-master-0
|   `-- 00000000000101790264.kafka
|-- access_log@nginx-nginx-api-master-1
|   `-- 00000000000650193547.kafka
|-- access_log@nginx-nginx-api-master-4
|   `-- 00000000000516227252.kafka
|-- access_log@nginx-nginx-api-master-5
|   `-- 00000000000062572953.kafka
|-- access_log@nginx-nginx-api-master-6
|   `-- 00000000000566421014.kafka
|-- access_log@nginx-nginx-api-master-8
|   `-- 00000000000892503077.kafka
|-- access_log@nginx-nginx-api-v1-0
|   `-- 00000000000011969830.kafka
|-- access_log@nginx-nginx-api-v1-2
|   `-- 00000000000019642155.kafka
|-- access_log@nginx-nginx-api-v1-3
|   `-- 00000000000000636597.kafka

Thanks!
Javier Iseruk
On Thu, May 9, 2013 at 1:18 PM, Neha Narkhede <[EMAIL PROTECTED]>wrote:
Javier Iseruk
Architecture Team
Phone: +5411-4640-8063

 
+
Javier Iseruk 2013-05-09, 20:18
+
Dennis Haller 2013-05-13, 15:09
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB