Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # user - complie drill with hadoop2.2.0


Copy link to this message
-
Re: complie drill with hadoop2.2.0
YouPeng Yang 2013-12-19, 10:16
Hi
  I take a stupid solution to switch the* default-hadoop* profile  and
the  *cdh
*profile, also make changes in the pom.xml files as :
  exec/java-exec/pom.xml,
  exec/ref/pom.xml ,
  sqlparser/pom.xml,
  exec/ref/pom.xml.

  Finally,the complie succeed.I do found the hadoop-2.x.jar of cdh in the
final apache-drill-1.0.0-m1-incubating-binary-release.tar.gz
*[drill@hadoop1 target]$ ls apache-drill-1.0.0-m1-incubating/lib/ha*
hadoop-annotations-2.0.0-cdh4.4.0.jar
hadoop-common-2.0.0-cdh4.4.0.jar
hazelcast-2.5.1.jar
hadoop-auth-2.0.0-cdh4.4.0.jar         hamcrest-core-1.3.jar
  Is there any better solutions? I do want to complie drill  simply with
maven profile  .
[drill@hadoop1 apache-drill-1.0.0-m1-incubating]$mvn clean install
-DskipTests  -Pcdh

*  Or I have to make the change as above. *
2013/12/17 Jacques Nadeau <[EMAIL PROTECTED]>

> I think there are multiple references to the jar.  Some for building and
> some for packaging.  Check out the pom in the distribution folder.
>
>
> On Tue, Dec 17, 2013 at 6:58 AM, YouPeng Yang <[EMAIL PROTECTED]
> >wrote:
>
> > Hi
> >    I try to complie the drill with Hadoop 2.2 using the command
> >    mvn clean install -Dskiptes -Pcdh.
> >
> >    I try to use cdh the maven native  profile in the pom.xml. It complied
> > successfully,however there are no cdh hadoop jars in bin tar.gz .
> >
> >    Did I miss something?
> >
> >
> > Regards.
> >
> >
> >
> >
> >
> >
> > 2013/12/14 Jacques Nadeau <[EMAIL PROTECTED]>
> >
> > > I can't remember the analog but there are a set that match.  If you
> want
> > to
> > > file a jira,  we'll try to get to it soon.
> > >
> > > Thx
> > > Jacques
> > > On Dec 13, 2013 5:10 PM, "yypvsxf19870706" <[EMAIL PROTECTED]>
> > > wrote:
> > >
> > > > hi
> > > >
> > > >     Sorry,I do not have tried,the hadoop2.2 does not contain the
> > > >  hadoop-core.jar,  So I thought it might not go well.
> > > >     Any way I will try. Thanks.
> > > >
> > > > 发自我的 iPhone
> > > >
> > > > 在 2013-12-14,2:15,Jason Altekruse <[EMAIL PROTECTED]> 写道:
> > > >
> > > > > Hi YouPeng,
> > > > >
> > > > > Not sure if I'm misunderstanding what you've already tried, but at
> > the
> > > > top
> > > > > of the pom file is the entry for hadoop, did you try just changing
> > the
> > > > > version number and building?
> > > > >
> > > > > <dependency>
> > > > >            <groupId>org.apache.hadoop</groupId>
> > > > >            <artifactId>hadoop-core</artifactId>
> > > > > <!-- change this line below -->
> > > > >            <version>1.2.1</version>
> > > > >            <exclusions>
> > > > >              <exclusion>
> > > > >                <artifactId>jets3t</artifactId>
> > > > >                <groupId>net.java.dev.jets3t</groupId>
> > > > >              </exclusion>
> > > > >              <exclusion>
> > > > >                <artifactId>log4j</artifactId>
> > > > >                <groupId>log4j</groupId>
> > > > >              </exclusion>
> > > > > Please let us know how the build goes, we have Hadoop 2 and YARN
> > > support
> > > > on
> > > > > our roadmap.
> > > > >
> > > > > -Jason Altekruse
> > > > >
> > > > >
> > > > > On Fri, Dec 13, 2013 at 2:48 AM, YouPeng Yang <
> > > [EMAIL PROTECTED]
> > > > >wrote:
> > > > >
> > > > >> Hi Drill users
> > > > >>
> > > > >>  Again.
> > > > >>   Would anyone give me some tips to comple drill will
> hadoop-2.2.0?
> > > > >>
> > > > >> regards
> > > > >>
> > > > >>
> > > > >> 2013/12/11 YouPeng Yang <[EMAIL PROTECTED]>
> > > > >>
> > > > >>> Hi drill users
> > > > >>>
> > > > >>>   I have complie the drill src,however default hadoop version
> that
> > is
> > > > >>> included in drill is 1.2.1.My test hadoop cluster  is 2.2.0.
> > > > >>>   I want to complie drill with hadoop2.2.0 ,please tell me how to
> > > > modify
> > > > >>> the pom.xml.
> > > > >>>   I got the hadoop part in the  pom.xml as following:
> > > > >>>
> > > > >>>
> > > > >>>   <dependency>
> > > > >>>            <groupId>org.apache.hadoop</groupId>