Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # dev >> Building Hadoop from source code


+
Mohammad Mustaqeem 2013-04-08, 15:06
+
Mohammad Mustaqeem 2013-04-08, 15:08
+
Steve Loughran 2013-04-08, 18:39
+
Mohammad Mustaqeem 2013-04-09, 08:08
+
Ling Kun 2013-04-09, 08:28
+
maisnam ns 2013-04-09, 08:38
+
Mohammad Mustaqeem 2013-04-09, 09:02
+
Mohammad Mustaqeem 2013-04-09, 11:24
+
maisnam ns 2013-04-09, 11:45
+
maisnam ns 2013-04-09, 11:52
Copy link to this message
-
Re: Building Hadoop from source code
@maisnam, I am using ubuntu and after running svn I get hadoop folder as
given in screenshot.
I didn't finf any build folder
On Tue, Apr 9, 2013 at 5:22 PM, maisnam ns <[EMAIL PROTECTED]> wrote:

> @@Mohammad Mustaqeem please ignore the earlier mail as the screenshots
> where not copied in the mail I have attached a doc file.
>
> You can follow the steps earlier using the screenshots I have attached.
>
>
> On Tue, Apr 9, 2013 at 5:15 PM, maisnam ns <[EMAIL PROTECTED]> wrote:
>
>> @Mohammad Mustaqeem please follow the screenshots one by one
>>
>>
>> cd build you will find
>>
>>
>> Now cd hadoop-0.20.3-dev you will find the below screenshot
>>
>>
>> Now the bin contains all the scripts you may need to start hadoop
>> 1. Go to that bin directory and format your namenode
>> 2. configure you site-xmls
>> 3. start-all.sh  note there are other ways also
>> 4. do jps to see if all daemons are running
>>
>>
>>
>> On Tue, Apr 9, 2013 at 4:54 PM, Mohammad Mustaqeem <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Please, anyone tell me where is the build hadoop??
>>> that can be used to install the hadoop cluster.
>>>
>>>
>>> On Tue, Apr 9, 2013 at 2:32 PM, Mohammad Mustaqeem
>>> <[EMAIL PROTECTED]>wrote:
>>>
>>> > @Ling, you mean to say to run "find -name *tar*"??
>>> > I run but don't know which file will be used to install Hadoop.
>>> >
>>> > @Niranjan
>>> > I haven't changed anything I just executed "svn checkout
>>> > http://svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk" to
>>> get
>>> > the Hadoop source code in the "hadoop-trunk" directory.
>>> > After that I executed the "cd hadoop-trunk" and finally executed "mvn
>>> > package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true".
>>> > I want to ask what is location of tar file created which can be used to
>>> > install the Hadoop ??
>>> >
>>> >
>>> > On Tue, Apr 9, 2013 at 2:08 PM, maisnam ns <[EMAIL PROTECTED]>
>>> wrote:
>>> >
>>> >> @Mohammad Mustaqeem - Once you create the patch as given in the 'How
>>> to
>>> >> contribute to Hadoop' and apply the patch. The  changes will be
>>> reflected
>>> >> in the files you have modified.
>>> >>
>>> >> 1.Now you trigger the build ant or maven. I tried with ant so the ant
>>> >> command I gave is  ant clean compile bin-package. Don't forget to
>>> download
>>> >> ivy.jar and copy into you ant home/ lib folder. Once the build is
>>> >> triggered
>>> >> Hadoop should get built along with the changes you made.
>>> >>
>>> >> If , I am not mistaken , you modified some hadoop files say
>>> >> BlockLocation.java, in your
>>> >> Hadoopx.x\src\core\org\apache\hadoop\fs\BlockLocation.java.
>>> >>
>>> >> The jar will be in Hadoopx.x\build\hadoop-0.20.3-dev-core.jar(In my
>>> >> version)
>>> >>
>>> >> Hope this clears your doubt.
>>> >>
>>> >> Regards
>>> >> Niranjan Singh
>>> >>
>>> >>
>>> >> On Tue, Apr 9, 2013 at 1:38 PM, Mohammad Mustaqeem
>>> >> <[EMAIL PROTECTED]>wrote:
>>> >>
>>> >> > @Steve
>>> >> > I am new to Hadoop developement.
>>> >> > Can you please tell me, whats is the location of tar file??
>>> >> >
>>> >> >
>>> >> > On Tue, Apr 9, 2013 at 12:09 AM, Steve Loughran <
>>> [EMAIL PROTECTED]
>>> >> > >wrote:
>>> >> >
>>> >> > > On 8 April 2013 16:08, Mohammad Mustaqeem <[EMAIL PROTECTED]
>>> >
>>> >> > wrote:
>>> >> > >
>>> >> > > > Please, tell what I am doing wrong??
>>> >> > > > Whats the problem??
>>> >> > > >
>>> >> > >
>>> >> > > a lot of these seem to be network-related tests. You can turn off
>>> all
>>> >> the
>>> >> > > tests; look in BUILDING.TXT at the root of the source tree for the
>>> >> > various
>>> >> > > operations, then add -DskipTests to the end of every command,
>>> such as
>>> >> > >
>>> >> > > mvn package -Pdist -Dtar -DskipTests
>>> >> > >
>>> >> > > to build the .tar packages
>>> >> > >
>>> >> > >  mvn package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true
>>> >> > > to turn off the javadoc creation too, for an even faster build
>>> >> > >
>>> >> >
>>> >> >
>>> >> >
>>

*With regards ---*
*Mohammad Mustaqeem*,
M.Tech (CSE)
MNNIT Allahabad
9026604270
+
Ling Kun 2013-04-09, 12:07
+
Mohammad Mustaqeem 2013-04-09, 12:25
+
Ling Kun 2013-04-09, 12:59
+
Mohammad Mustaqeem 2013-04-09, 13:15
+
Harsh J 2013-04-09, 13:48
+
Amir Sanjar 2013-04-09, 13:30
+
Mohammad Mustaqeem 2013-04-09, 13:36
+
Amir Sanjar 2013-04-09, 14:12
+
Mohammad Mustaqeem 2013-04-08, 15:11