Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # dev - 0.8.0-beta1 is now available in public maven


Copy link to this message
-
Re: 0.8.0-beta1 is now available in public maven
Joe Stein 2013-07-15, 18:24
hmmm, interesting

I think the issue is that I had to-do multiple pushes to nexus to get this
to work (unfortunately) and perhaps maven central did not overwrite like it
did with apache rather appending and meshing the poms together.  The POM in
maven central looks like a combination of what I was doing in
https://issues.apache.org/jira/browse/KAFKA-974

Please create a JIRA however I suspect when we do another release (either
0.8.0-beta2 or 0.8.0) this will be correct and 1:1 from apache repo because
I won't be doing multiple pushes like i had to-do here

the weird parent block is required by apache when releasing
http://www.apache.org/dev/publishing-maven-artifacts.html as I understand
it and read the docs

perhaps for 0.8.0-beta1 folks should just use the repo
https://repository.apache.org/content/repositories/releases/ because
matches the POM from the 0.8 branch

great to be working all this stuff out in beta1 so we can have a nice clean
0.8 release =8^)

On Mon, Jul 15, 2013 at 2:12 PM, Chris Riccomini <[EMAIL PROTECTED]>wrote:

> Hey Guys,
>
> Digging into this more. Here's a fun fact: Maven Central's POM does not
> match Apache release's.
>
>
> http://search.maven.org/remotecontent?filepath=org/apache/kafka/kafka_2.9.2
> /0.8.0-beta1/kafka_2.9.2-0.8.0-beta1.pom
>
>
> https://repository.apache.org/content/groups/public/org/apache/kafka/kafka_
> 2.9.2/0.8.0-beta1/kafka_2.9.2-0.8.0-beta1.pom
>
> Notice in Maven central that it has two <dependencies> blocks. That
> doesn't exist in Apache release's. Weird.
>
> On a hunch, I explicitly added the Apache release repository as the first
> repo that Gradle uses:
>
>   allprojects {
>     repositories {
>       maven {
>         url 'https://repository.apache.org/content/groups/public'
>       }
>       mavenCentral()
>     }
>   }
>
>
> This worked! I still have to manually add the exclusions:
>
>   compile("org.apache.kafka:kafka_$scalaVersion:$kafkaVersion") {
>     exclude module: 'jms'
>     exclude module: 'jmxtools'
>     exclude module: 'jmxri'
>   }
>
>
> After that, I got a successful build. I still think the POM is pretty
> broken, though. Here are the issues I see:
>
> 1. Maven central can't resolve it properly (POM is different from Apache
> release). Have to use Apache release repo directly to get things to work.
> 2. Exclusions must be manually applied even though they exist in Kafka's
> POM already. I think Maven can handle this automatically, if the POM is
> done right.
> 3. Weird parent block in Kafka POMs that points to org.apache.
> 4. Would be nice to publish kafka-test jars as well.
> 5. Would be nice to have SNAPSHOT releases off of trunk using a Hudson job.
>
> Shall I open Jiras for this stuff?
>
> Cheers,
> Chris
>
> On 7/15/13 10:55 AM, "Chris Riccomini" <[EMAIL PROTECTED]> wrote:
>
> >Hey Guys,
> >
> >The problem persists, even when using the explicit URL Joe provided.
> >
> >I've also constructed a dummy Maven project, and tested Kafka dependencies
> >there. That worked, but I had to explicit write the <exclusion> block.
> >
> >I might have to sick our local Gradle experts on this one...
> >
> >Cheers,
> >Chris
> >
> >On 7/15/13 10:45 AM, "chetan conikee" <[EMAIL PROTECTED]> wrote:
> >
> >>I stumbled on a few issues when I was attempting to create a Scala based
> >>Client (Producer/Consumer) project.
> >>
> >>Finally worked after revisions:
> >>
> >>
> >>Here's the snippet of by build.sbt
> >>
> >>~~~~~~~~~~
> >>
> >>/* scala versions and options */
> >>scalaVersion := "2.9.2"
> >>
> >>
> >>libraryDependencies +=
> >>    "org.apache.kafka" % "kafka_2.9.2" % "0.8.0-beta1" excludeAll(
> >>    ExclusionRule(organization = "com.sun.jdmk"),
> >>    ExclusionRule(organization = "com.sun.jmx"),
> >>    ExclusionRule(organization = "javax.jms")
> >>  )
> >>
> >>
> >>/* you may need these repos */
> >>resolvers := Seq(
> >>  "maven" at "http://mvnrepository.com",
> >>  "maven atrifactory" at "http://central.maven.org/maven2",
> >>  "sonatype releases" at "

/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/