Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> problems with one of my tests and the latest 0.8 branch


Copy link to this message
-
Re: problems with one of my tests and the latest 0.8 branch
Ok,

Contrary to what I said above, the issue does seem to occur when kafka is
launched by the sample startup scripts.  I've filed a bug, with a
test-case:  https://issues.apache.org/jira/browse/KAFKA-945

I'm hoping there's a simple thing to change in the test code that will
solve this (but I suspect there's an underlying problem).

Jason
On Mon, Jun 17, 2013 at 6:05 PM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:

> Hmmm....that's not working for me (no *.sources.jar files are generated).
>  do I need to add a flag?
>
>
> On Mon, Jun 17, 2013 at 5:47 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
>
>> Yup, depending on your Scala version
>>
>> ./sbt "++2.9.2 package"
>>
>> 2.8.0, 2.8.2, 2.9.1, 2.9.2 are available
>>
>> /*
>> Joe Stein, Chief Architect
>> http://www.medialets.com
>> Twitter: @allthingshadoop
>> Mobile: 917-597-9771
>> */
>>
>> On Jun 17, 2013, at 8:41 PM, Jason Rosenberg <[EMAIL PROTECTED]> wrote:
>>
>> > Joe,
>> >
>> > I there also a way to generate a sources jar via sbt?
>> >
>> > Thanks,
>> >
>> > Jason
>> >
>> >
>> > On Mon, Jun 17, 2013 at 5:28 PM, Jason Rosenberg <[EMAIL PROTECTED]>
>> wrote:
>> >
>> >> Another thing I notice, is that the sample 'config/server.properties'
>> in
>> >> many cases seems to have no correlation to the default config
>> properties.
>> >> In some cases, it offers much greater allocation (e.g. for
>> >> socket.send.buffer.bytes, and for others much less.
>> >>
>> >> Have all the sample settings in config/server.properties been vetted
>> for
>> >> the new config values?
>> >>
>> >> Jason
>> >>
>> >>
>> >> On Mon, Jun 17, 2013 at 5:23 PM, Joe Stein <[EMAIL PROTECTED]> wrote:
>> >>
>> >>> you can use this to build the binary distributable
>> >>>
>> >>> ./sbt release-tar
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> On Mon, Jun 17, 2013 at 8:17 PM, Jason Rosenberg <[EMAIL PROTECTED]>
>> >>> wrote:
>> >>>
>> >>>> Looking at the convenience script for running kafka server, it
>> builds a
>> >>>> classpath by looking in several directories (looking at
>> >>>> kafka-run-class.sh).
>> >>>>
>> >>>> This script includes a jar under perf/target, should I care about
>> that,
>> >>>> when launching a mavenized version of the server?
>> >>>>
>> >>>> Also, it includes jars under the "libs/" directory, which doesn't
>> exist
>> >>>> (there is a "lib/') dir.  Is that an oversight?
>> >>>>
>> >>>> Finally, it includes top-level jars that match kafka*.jar, which
>> don't
>> >>>> exist from what I can tell.
>> >>>>
>> >>>> Or is there an extra sbt command I need to run to build out more
>> >>>> directories?
>> >>>>
>> >>>> Jason
>> >>>>
>> >>>>
>> >>>> On Mon, Jun 17, 2013 at 4:48 PM, Jason Rosenberg <[EMAIL PROTECTED]>
>> >>> wrote:
>> >>>>
>> >>>>> Ok,
>> >>>>>
>> >>>>> So it seems the issue is related somehow to how I've wrapped the
>> >>> server
>> >>>>> (using a container app, using the maven pom from "./sbt make-pom").
>> >>> If
>> >>>> I
>> >>>>> start the server using the script "kafka-server-start.sh", it works
>> >>> fine.
>> >>>>> Still looking (but haven't been able to see anything obvious so
>> far).
>> >>>>>
>> >>>>> Jason
>> >>>>>
>> >>>>>
>> >>>>> On Sun, Jun 16, 2013 at 8:46 PM, Joe Stein <[EMAIL PROTECTED]>
>> >>> wrote:
>> >>>>>
>> >>>>>> Jason,
>> >>>>>>
>> >>>>>> I just uploaded a signed binary build (kafka_2.8.2-0.8.0-beta1.jar)
>> >>> to
>> >>>> the
>> >>>>>> artifacts
>> >>>>>> http://people.apache.org/~joestein/kafka-0.8.0-beta1-candidate1/
>> >>>>>>
>> >>>>>> I also uploaded a 2.9.2 binary too kafka_2.9.2-0.8.0-beta1.jar
>> >>>>>>
>> >>>>>>
>> >>>>>> On Sun, Jun 16, 2013 at 11:36 PM, Jason Rosenberg <
>> [EMAIL PROTECTED]>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> Joe,
>> >>>>>>>
>> >>>>>>> So I am using the 2.8.2 build of the kafka jar, using that latest
>> >>>>>>> beta1-candidate1 tag.
>> >>>>>>>
>> >>>>>>> The code above should be all you need to reproduce the issue.
>>  I'll
>> >>>>>> create
>> >>>>>>> a JIRA ticket.
>> >>>>>>>
>> >>>>>>> Thanks,
>> >>>>>>>
>> >>>>>>> Jason
>> >>>>>>>
>> >>>