Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> problems with one of my tests and the latest 0.8 branch


+
Jason Rosenberg 2013-06-16, 21:14
+
Eric Sites 2013-06-16, 22:04
+
Jason Rosenberg 2013-06-17, 03:15
+
Joe Stein 2013-06-17, 03:33
+
Jason Rosenberg 2013-06-17, 03:36
Copy link to this message
-
Re: problems with one of my tests and the latest 0.8 branch
Jason,

I just uploaded a signed binary build (kafka_2.8.2-0.8.0-beta1.jar) to the
artifacts http://people.apache.org/~joestein/kafka-0.8.0-beta1-candidate1/

I also uploaded a 2.9.2 binary too kafka_2.9.2-0.8.0-beta1.jar
On Sun, Jun 16, 2013 at 11:36 PM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:

> Joe,
>
> So I am using the 2.8.2 build of the kafka jar, using that latest
> beta1-candidate1 tag.
>
> The code above should be all you need to reproduce the issue.  I'll create
> a JIRA ticket.
>
> Thanks,
>
> Jason
>
>
> On Sun, Jun 16, 2013 at 8:32 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
>
> > I have been running tests on 2.9.2 and 2.8.2 without any issues off the
> > beta1-candidate1 release tag
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tag;h=refs/tags/0.8.0-beta1
> >
> > Binaries will be built from the source file available from download here
> :
> > http://people.apache.org/~joestein/kafka-0.8.0-beta1-candidate1/
> >
> > It could be that test failing is interacting with a local file already
> > there and causing issues or such type of thing not reproducible maybe
> > without failing the test first to cause the data not cleaned up or
> > something, dunno.
> >
> > If you have an issue can you put the steps to reproduce it together or
> > whatever amount of detailed information you can provide and then please
> > open up a JIRA ticket https://issues.apache.org/jira/browse/KAFKA
> >
> > Thanks!
> >
> >
> > On Sun, Jun 16, 2013 at 11:14 PM, Jason Rosenberg <[EMAIL PROTECTED]>
> > wrote:
> >
> > > Yep,
> > >
> > > The configs are good.  And my apps are working fine too.  It seems only
> > to
> > > be an issue with this test (and a few others like it).
> > >
> > > Jason
> > >
> > >
> > > On Sun, Jun 16, 2013 at 3:02 PM, Eric Sites <
> [EMAIL PROTECTED]
> > > >wrote:
> > >
> > > > Jason,
> > > >
> > > >
> > > > Did you update your config file with the new name of the zookeeper
> > > > settings:
> > > >
> > > > It was renamed from zk.connect to zookeeper.connect.
> > > >
> > > > You should check all of the settings because other setting names have
> > > > changed as well.
> > > >
> > > > Cheers,
> > > > Eric Sites
> > > >
> > > > On 6/16/13 5:14 PM, "Jason Rosenberg" <[EMAIL PROTECTED]> wrote:
> > > >
> > > > >I've started having problems with the latest version of the 0.8
> > branch.
> > > > > The test below has started failing.  It was working fine with a
> prior
> > > > >version of 0.8, going back to Apr 30
> > > > >(sha 988d4d8e65a14390abd748318a64e281e4a37c19).
> > > > >
> > > > >I haven't figured out when exactly it started failing, but I saw it
> > > with a
> > > > >version on Jun 9 (sha ddb7947c05583ea317e8f994f07b83bf6d5213c3) and
> > now
> > > > >also with the latest (sha 23acbd309f5e17de71db46cb6f1a60c8d38ea4e4).
> > > > >
> > > > >The test code is essentially this (assume a zk server is running
> with
> > > > >'zkConnect', and a kafka broker running with a metadata port at
> > 'port':
> > > > >
> > > > >    Properties pProps = new Properties();
> > > > >    pProps.put("metadata.broker.list", "localhost:" + port);
> > > > >    pProps.put("serializer.class",
> "kafka.serializer.StringEncoder");
> > > > >    ProducerConfig pConfig = new ProducerConfig(pProps);
> > > > >    Producer<Integer, String> producer = new Producer<Integer,
> > > > >String>(pConfig);
> > > > >    KeyedMessage<Integer, String> data =
> > > > >        new KeyedMessage<Integer, String>("test-topic",
> > "test-message");
> > > > >    producer.send(data);
> > > > >    producer.close();
> > > > >
> > > > >    Properties cProps = new Properties();
> > > > >    cProps.put("zookeeper.connect", zkConnect);
> > > > >    cProps.put("group.id", "group1");
> > > > >    ConsumerConfig consumerConfig = new ConsumerConfig(cProps);
> > > > >    ConsumerConnector consumerConnector =
> > > > >Consumer.createJavaConsumerConnector(consumerConfig);
> > > > >
> > > > >    Map<String, List<KafkaStream<byte[], byte[]>>>
> > topicMessageStreams =
/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/

 
+
Jason Rosenberg 2013-06-17, 23:49
+
Jason Rosenberg 2013-06-18, 00:17
+
Joe Stein 2013-06-18, 00:23
+
Jason Rosenberg 2013-06-18, 00:28
+
Jason Rosenberg 2013-06-18, 00:42
+
Joe Stein 2013-06-18, 00:48
+
Jason Rosenberg 2013-06-18, 01:05
+
Jason Rosenberg 2013-06-18, 05:58