Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # dev >> Building Hadoop from source code


+
Mohammad Mustaqeem 2013-04-08, 15:06
+
Mohammad Mustaqeem 2013-04-08, 15:08
+
Steve Loughran 2013-04-08, 18:39
+
Mohammad Mustaqeem 2013-04-09, 08:08
+
Ling Kun 2013-04-09, 08:28
+
maisnam ns 2013-04-09, 08:38
+
Mohammad Mustaqeem 2013-04-09, 09:02
+
Mohammad Mustaqeem 2013-04-09, 11:24
+
maisnam ns 2013-04-09, 11:45
+
maisnam ns 2013-04-09, 11:52
+
Mohammad Mustaqeem 2013-04-09, 11:58
Copy link to this message
-
Re: Building Hadoop from source code
@Mohammad:
  1. have you successfully run the command Steve suggested?  "mvn package
-Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true"
  2. If yes, and then you can use the command " find . -name "*tar*" " to
find the tar file, which is in the path
"./hadoop-dist/target/hadoop-3.0.0-SNAPSHOT.tar.gz"

  3. Sorry, I make a mistake about the tar file name, It is tar.gz
@ maisnam ns:
    I am afraid the version you are using is not the same as Mohammad used.
Ling Kun
On Tue, Apr 9, 2013 at 7:58 PM, Mohammad Mustaqeem
<[EMAIL PROTECTED]>wrote:

> @maisnam, I am using ubuntu and after running svn I get hadoop folder as
> given in screenshot.
> I didn't finf any build folder
>
>
> On Tue, Apr 9, 2013 at 5:22 PM, maisnam ns <[EMAIL PROTECTED]> wrote:
>
>> @@Mohammad Mustaqeem please ignore the earlier mail as the screenshots
>> where not copied in the mail I have attached a doc file.
>>
>> You can follow the steps earlier using the screenshots I have attached.
>>
>>
>> On Tue, Apr 9, 2013 at 5:15 PM, maisnam ns <[EMAIL PROTECTED]> wrote:
>>
>>> @Mohammad Mustaqeem please follow the screenshots one by one
>>>
>>>
>>> cd build you will find
>>>
>>>
>>> Now cd hadoop-0.20.3-dev you will find the below screenshot
>>>
>>>
>>> Now the bin contains all the scripts you may need to start hadoop
>>> 1. Go to that bin directory and format your namenode
>>> 2. configure you site-xmls
>>> 3. start-all.sh  note there are other ways also
>>> 4. do jps to see if all daemons are running
>>>
>>>
>>>
>>> On Tue, Apr 9, 2013 at 4:54 PM, Mohammad Mustaqeem <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Please, anyone tell me where is the build hadoop??
>>>> that can be used to install the hadoop cluster.
>>>>
>>>>
>>>> On Tue, Apr 9, 2013 at 2:32 PM, Mohammad Mustaqeem
>>>> <[EMAIL PROTECTED]>wrote:
>>>>
>>>> > @Ling, you mean to say to run "find -name *tar*"??
>>>> > I run but don't know which file will be used to install Hadoop.
>>>> >
>>>> > @Niranjan
>>>> > I haven't changed anything I just executed "svn checkout
>>>> > http://svn.apache.org/repos/asf/hadoop/common/trunk/ hadoop-trunk"
>>>> to get
>>>> > the Hadoop source code in the "hadoop-trunk" directory.
>>>> > After that I executed the "cd hadoop-trunk" and finally executed "mvn
>>>> > package -Pdist -Dtar -DskipTests -Dmaven.javadoc.skip=true".
>>>> > I want to ask what is location of tar file created which can be used
>>>> to
>>>> > install the Hadoop ??
>>>> >
>>>> >
>>>> > On Tue, Apr 9, 2013 at 2:08 PM, maisnam ns <[EMAIL PROTECTED]>
>>>> wrote:
>>>> >
>>>> >> @Mohammad Mustaqeem - Once you create the patch as given in the 'How
>>>> to
>>>> >> contribute to Hadoop' and apply the patch. The  changes will be
>>>> reflected
>>>> >> in the files you have modified.
>>>> >>
>>>> >> 1.Now you trigger the build ant or maven. I tried with ant so the ant
>>>> >> command I gave is  ant clean compile bin-package. Don't forget to
>>>> download
>>>> >> ivy.jar and copy into you ant home/ lib folder. Once the build is
>>>> >> triggered
>>>> >> Hadoop should get built along with the changes you made.
>>>> >>
>>>> >> If , I am not mistaken , you modified some hadoop files say
>>>> >> BlockLocation.java, in your
>>>> >> Hadoopx.x\src\core\org\apache\hadoop\fs\BlockLocation.java.
>>>> >>
>>>> >> The jar will be in Hadoopx.x\build\hadoop-0.20.3-dev-core.jar(In my
>>>> >> version)
>>>> >>
>>>> >> Hope this clears your doubt.
>>>> >>
>>>> >> Regards
>>>> >> Niranjan Singh
>>>> >>
>>>> >>
>>>> >> On Tue, Apr 9, 2013 at 1:38 PM, Mohammad Mustaqeem
>>>> >> <[EMAIL PROTECTED]>wrote:
>>>> >>
>>>> >> > @Steve
>>>> >> > I am new to Hadoop developement.
>>>> >> > Can you please tell me, whats is the location of tar file??
>>>> >> >
>>>> >> >
>>>> >> > On Tue, Apr 9, 2013 at 12:09 AM, Steve Loughran <
>>>> [EMAIL PROTECTED]
>>>> >> > >wrote:
>>>> >> >
>>>> >> > > On 8 April 2013 16:08, Mohammad Mustaqeem <
>>>> [EMAIL PROTECTED]>
>>>> >> > wrote:
>>>> >> > >
>>>> >> > > > Please, tell what I am doing wrong??
http://www.lingcc.com
+
Mohammad Mustaqeem 2013-04-09, 12:25
+
Ling Kun 2013-04-09, 12:59
+
Mohammad Mustaqeem 2013-04-09, 13:15
+
Harsh J 2013-04-09, 13:48
+
Amir Sanjar 2013-04-09, 13:30
+
Mohammad Mustaqeem 2013-04-09, 13:36
+
Amir Sanjar 2013-04-09, 14:12
+
Mohammad Mustaqeem 2013-04-08, 15:11