Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # dev >> Re: Mavenizing the HDFS build


Copy link to this message
-
Re: Mavenizing the HDFS build
I believe these JIRAs should address those issues:

https://issues.apache.org/jira/browse/HADOOP-7563
https://issues.apache.org/jira/browse/HDFS-2277

--
Aaron T. Myers
Software Engineer, Cloudera

On Mon, Aug 22, 2011 at 1:16 PM, Thomas Graves <[EMAIL PROTECTED]>wrote:

> What is the expected way to run from the tarballs?
>
> It seems if I just untar them so they are in their separate directories (
> hadoop-common-0.23.0-SNAPSHOT/, hadoop-hdfs-0.23.0-SNAPSHOT/,
> hadoop-mapreduce-1.0-SNAPSHOT/), setup the ENV vars for HADOOP_COMMON_HOME,
> HADOOP_HDFS_HOME, etc.. It won't run like I would expect it to.  Certain
> things like hadoop-config.sh are in libexec and it expects them in bin,
> things in hdfs bin it looks for in common bin, things are in sbin but it
> wants them in bin, it now can't seem to find the hdfs jars, etc..
>  Hopefully
> I'm missing something simple to make this work?
>
> Thanks,
> Tom Graves
>
> On 8/19/11 12:55 PM, "Tom White" <[EMAIL PROTECTED]> wrote:
>
> > HDFS-2096 is now committed to trunk. The instructions for building
> > HDFS can be found in the top-level BUILDING.txt file.
> >
> > I added a script to https://issues.apache.org/jira/browse/HADOOP-7500
> > to help with migrating HDFS patches to the new layout.
> >
> > There are a few follow-up patches that need doing soon (e.g.
> > HADOOP-7498, HADOOP-7496, MAPREDUCE-2856), but these shouldn't stop
> > folks from doing development as usual.
> >
> > Thanks to everyone who helped with this!
> >
> > Cheers,
> > Tom
> >
> > On Thu, Aug 18, 2011 at 11:30 AM, Tom White <[EMAIL PROTECTED]> wrote:
> >> Now that MR-279 has been merged into trunk, I plan to commit the HDFS
> >> mavenization changes tomorrow (Friday) at 9am PDT.
> >>
> >> Cheers,
> >> Tom
> >>
> >> On Mon, Aug 15, 2011 at 1:24 PM, Arun C Murthy <[EMAIL PROTECTED]>
> wrote:
> >>> Thanks Tom.
> >>>
> >>> I'm running the final set of tests with the 'MR-279 rebased on trunk'
> and
> >>> should be done by tmrw.
> >>>
> >>> Also, can you guys please ensure that secure HDFS works after
> mvn'ization?
> >>>
> >>> thanks,
> >>> Arun
> >>>
> >>> On Aug 13, 2011, at 9:39 PM, Tom White wrote:
> >>>
> >>>> Hi Arun,
> >>>>
> >>>> I'm fine with that. When do you expect to start the vote?
> >>>>
> >>>> Cheers,
> >>>> Tom
> >>>>
> >>>> On Fri, Aug 12, 2011 at 11:41 PM, Arun C Murthy <[EMAIL PROTECTED]>
> >>>> wrote:
> >>>>> Hi Tom,
> >>>>>
> >>>>>  Can I request you to wait on this commit until we merge MR-279? As
> Vinod
> >>>>> pointed out in his mail to mapreduce-dev@ we are very close to
> getting the
> >>>>> merge done. We should call a vote asap. By holding off it the mvn
> patch it
> >>>>> will save us a bit of time - we spent at more than a couple of days
> on
> >>>>> resolving after the common mvn'ization.
> >>>>>
> >>>>>  Thanks for understanding.
> >>>>>
> >>>>> Arun
> >>>>>
> >>>>> On Aug 12, 2011, at 4:18 PM, Tom White wrote:
> >>>>>
> >>>>>> The work in https://issues.apache.org/jira/browse/HDFS-2096 is
> ready
> >>>>>> to be committed, so unless there are any objections I will do so on
> >>>>>> Monday at 5pm UTC (that's 10am PDT, http://s.apache.org/o6F).
> >>>>>>
> >>>>>> I'll also create a script to convert patches to the new layout, and
> >>>>>> switch over the Jenkins jobs that test and build HDFS.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Tom
> >>>>>
> >>>>>
> >>>
> >>>
> >>
>
>