Hello,

Does anyone have notes on how to build Hadoop on a EC2 instance based on
the trunk?  I am trying to use http://wiki.apache.org/hadoop/HowToContribute.
I used a micro ec2 instance and when I ran mvn compile, some test ran out
of memory and the build failed.  I then tried a large ec2 instance, but it
seems gzip complains (looks like a buffer overrun of some sort.)

Kindest regards.

Ron

Friends,

I have modified the source program of hadoop 0.20.2, and i want to build it using  "ant"  but it's not working .

I use the following command

ant -Doffline=true -Dresolvers=internal

the ouput of this command looks like as follows:
clover.setup:

clover.info:
     [echo]
     [echo]      Clover not found. Code coverage reports disabled.
     [echo]  

clover:

ivy-download:

ivy-init-dirs:

ivy-probe-antlib:

ivy-init-antlib:

ivy-init:
[ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 :: http://ant.apache.org/ivy/ ::
:: loading settings :: file = /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml

ivy-resolve-common:
[ivy:resolve] :: resolving dependencies :: org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
[ivy:resolve]  confs: [common]
--------------------------------------------------------------------------------------------------------

and it stops there.
If anyone knows it how to build it, please let me know it.

Regards,

Mohmmdanis Moulavi

I think you should build it online for first time.

On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi <
[EMAIL PROTECTED]> wrote:

> Friends,
>
>
>
> I have modified the source program of hadoop 0.20.2, and i want to build
> it using  "ant"  but it's not working .
>
>
>
> I use the following command
>
>
>
> ant -Doffline=true -Dresolvers=internal
>
> the ouput of this command looks like as follows:
>
>
> clover.setup:
>
> clover.info:
>      [echo]
>      [echo]      Clover not found. Code coverage reports disabled.
>      [echo]
>
> clover:
>
> ivy-download:
>
> ivy-init-dirs:
>
> ivy-probe-antlib:
>
> ivy-init-antlib:
>
> ivy-init:
> [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> http://ant.apache.org/ivy/ ::
> :: loading settings :: file > /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml
>
> ivy-resolve-common:
> [ivy:resolve] :: resolving dependencies ::
> org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
> [ivy:resolve]  confs: [common]
>
>
>
> --------------------------------------------------------------------------------------------------------
>
> and it stops there.
>
>
> If anyone knows it how to build it, please let me know it.
>
>
>
> Regards,
>
> Mohmmdanis Moulavi
>

How can I skip dependency resolver,
without modification of code also it's not working at all

 
Thanks & Regards,

Mohmmadanis Moulavi

________________________________
 From: Prashant Sharma <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; mohmmadanis moulavi <[EMAIL PROTECTED]>
Sent: Friday, 18 November 2011 12:34 PM
Subject: Re: building hadoop
 
I think you should build it online for first time.

On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi <
[EMAIL PROTECTED]> wrote:

> Friends,
>
>
>
> I have modified the source program of hadoop 0.20.2, and i want to build
> it using  "ant"  but it's not working .
>
>
>
> I use the following command
>
>
>
> ant -Doffline=true -Dresolvers=internal
>
> the ouput of this command looks like as follows:
>
>
> clover.setup:
>
> clover.info:
>      [echo]
>      [echo]      Clover not found. Code coverage reports disabled.
>      [echo]
>
> clover:
>
> ivy-download:
>
> ivy-init-dirs:
>
> ivy-probe-antlib:
>
> ivy-init-antlib:
>
> ivy-init:
> [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> http://ant.apache.org/ivy/ ::
> :: loading settings :: file > /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml
>
> ivy-resolve-common:
> [ivy:resolve] :: resolving dependencies ::
> org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
> [ivy:resolve]  confs: [common]
>
>
>
> --------------------------------------------------------------------------------------------------------
>
> and it stops there.
>
>
> If anyone knows it how to build it, please let me know it.
>
>
>
> Regards,
>
> Mohmmdanis Moulavi
>

Bypassing dependency resolver is not possible as such.  Incase you are
behind a proxy which restricts downloading dependencies you can first build
it on a machine which has internet access using command 'ant clean
install'. And then you can simply copy the ivy2 chache ~/.ivy  to your
system and then try ant clean install.
-P

On Fri, Nov 18, 2011 at 3:57 PM, mohmmadanis moulavi <
[EMAIL PROTECTED]> wrote:

> How can I skip dependency resolver,
> without modification of code also it's not working at all
>
>
>
>
> Thanks & Regards,
>
> Mohmmadanis Moulavi
>
>
>
> ________________________________
>  From: Prashant Sharma <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; mohmmadanis moulavi <
> [EMAIL PROTECTED]>
> Sent: Friday, 18 November 2011 12:34 PM
> Subject: Re: building hadoop
>
> I think you should build it online for first time.
>
> On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi <
> [EMAIL PROTECTED]> wrote:
>
> > Friends,
> >
> >
> >
> > I have modified the source program of hadoop 0.20.2, and i want to build
> > it using  "ant"  but it's not working .
> >
> >
> >
> > I use the following command
> >
> >
> >
> > ant -Doffline=true -Dresolvers=internal
> >
> > the ouput of this command looks like as follows:
> >
> >
> > clover.setup:
> >
> > clover.info:
> >      [echo]
> >      [echo]      Clover not found. Code coverage reports disabled.
> >      [echo]
> >
> > clover:
> >
> > ivy-download:
> >
> > ivy-init-dirs:
> >
> > ivy-probe-antlib:
> >
> > ivy-init-antlib:
> >
> > ivy-init:
> > [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> > http://ant.apache.org/ivy/ ::
> > :: loading settings :: file > > /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml
> >
> > ivy-resolve-common:
> > [ivy:resolve] :: resolving dependencies ::
> > org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
> > [ivy:resolve]  confs: [common]
> >
> >
> >
> >
> --------------------------------------------------------------------------------------------------------
> >
> > and it stops there.
> >
> >
> > If anyone knows it how to build it, please let me know it.
> >
> >
> >
> > Regards,
> >
> > Mohmmdanis Moulavi
> >
>

I am sorry for my last post. There is no install target in ant. you may use
ant clean jar. Also you can press a tab after writing ant to see all
available targets.
On Fri, Nov 18, 2011 at 4:10 PM, Prashant Sharma
<[EMAIL PROTECTED]>wrote:

>
> Bypassing dependency resolver is not possible as such.  Incase you are
> behind a proxy which restricts downloading dependencies you can first build
> it on a machine which has internet access using command 'ant clean
> install'. And then you can simply copy the ivy2 chache ~/.ivy  to your
> system and then try ant clean install.
> -P
>
>
> On Fri, Nov 18, 2011 at 3:57 PM, mohmmadanis moulavi <
> [EMAIL PROTECTED]> wrote:
>
>> How can I skip dependency resolver,
>> without modification of code also it's not working at all
>>
>>
>>
>>
>> Thanks & Regards,
>>
>> Mohmmadanis Moulavi
>>
>>
>>
>> ________________________________
>>  From: Prashant Sharma <[EMAIL PROTECTED]>
>> To: [EMAIL PROTECTED]; mohmmadanis moulavi <
>> [EMAIL PROTECTED]>
>> Sent: Friday, 18 November 2011 12:34 PM
>> Subject: Re: building hadoop
>>
>> I think you should build it online for first time.
>>
>> On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi <
>> [EMAIL PROTECTED]> wrote:
>>
>> > Friends,
>> >
>> >
>> >
>> > I have modified the source program of hadoop 0.20.2, and i want to build
>> > it using  "ant"  but it's not working .
>> >
>> >
>> >
>> > I use the following command
>> >
>> >
>> >
>> > ant -Doffline=true -Dresolvers=internal
>> >
>> > the ouput of this command looks like as follows:
>> >
>> >
>> > clover.setup:
>> >
>> > clover.info:
>> >      [echo]
>> >      [echo]      Clover not found. Code coverage reports disabled.
>> >      [echo]
>> >
>> > clover:
>> >
>> > ivy-download:
>> >
>> > ivy-init-dirs:
>> >
>> > ivy-probe-antlib:
>> >
>> > ivy-init-antlib:
>> >
>> > ivy-init:
>> > [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 ::
>> > http://ant.apache.org/ivy/ ::
>> > :: loading settings :: file >> > /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml
>> >
>> > ivy-resolve-common:
>> > [ivy:resolve] :: resolving dependencies ::
>> > org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
>> > [ivy:resolve]  confs: [common]
>> >
>> >
>> >
>> >
>> --------------------------------------------------------------------------------------------------------
>> >
>> > and it stops there.
>> >
>> >
>> > If anyone knows it how to build it, please let me know it.
>> >
>> >
>> >
>> > Regards,
>> >
>> > Mohmmdanis Moulavi
>> >
>>
>
>

I want to build it offline anyway

 
Thanks & Regards,

Mohmmadanis Moulavi

________________________________
 From: Prashant Sharma <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; mohmmadanis moulavi <[EMAIL PROTECTED]>
Sent: Friday, 18 November 2011 4:10 PM
Subject: Re: building hadoop
 
Bypassing dependency resolver is not possible as such.  Incase you are
behind a proxy which restricts downloading dependencies you can first build
it on a machine which has internet access using command 'ant clean
install'. And then you can simply copy the ivy2 chache ~/.ivy  to your
system and then try ant clean install.
-P

On Fri, Nov 18, 2011 at 3:57 PM, mohmmadanis moulavi <
[EMAIL PROTECTED]> wrote:

> How can I skip dependency resolver,
> without modification of code also it's not working at all
>
>
>
>
> Thanks & Regards,
>
> Mohmmadanis Moulavi
>
>
>
> ________________________________
>  From: Prashant Sharma <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]; mohmmadanis moulavi <
> [EMAIL PROTECTED]>
> Sent: Friday, 18 November 2011 12:34 PM
> Subject: Re: building hadoop
>
> I think you should build it online for first time.
>
> On Fri, Nov 18, 2011 at 12:26 PM, mohmmadanis moulavi <
> [EMAIL PROTECTED]> wrote:
>
> > Friends,
> >
> >
> >
> > I have modified the source program of hadoop 0.20.2, and i want to build
> > it using  "ant"  but it's not working .
> >
> >
> >
> > I use the following command
> >
> >
> >
> > ant -Doffline=true -Dresolvers=internal
> >
> > the ouput of this command looks like as follows:
> >
> >
> > clover.setup:
> >
> > clover.info:
> >      [echo]
> >      [echo]      Clover not found. Code coverage reports disabled.
> >      [echo]
> >
> > clover:
> >
> > ivy-download:
> >
> > ivy-init-dirs:
> >
> > ivy-probe-antlib:
> >
> > ivy-init-antlib:
> >
> > ivy-init:
> > [ivy:configure] :: Ivy 2.0.0-rc2 - 20081028224207 ::
> > http://ant.apache.org/ivy/ ::
> > :: loading settings :: file > > /home/internal/studentpr/anis/hadoop-0.20.2/ivy/ivysettings.xml
> >
> > ivy-resolve-common:
> > [ivy:resolve] :: resolving dependencies ::
> > org.apache.hadoop#Hadoop;[EMAIL PROTECTED]m
> > [ivy:resolve]  confs: [common]
> >
> >
> >
> >
> --------------------------------------------------------------------------------------------------------
> >
> > and it stops there.
> >
> >
> > If anyone knows it how to build it, please let me know it.
> >
> >
> >
> > Regards,
> >
> > Mohmmdanis Moulavi
> >
>

On 18/11/11 11:02, mohmmadanis moulavi wrote:
> I want to build it offline anyway
>
>
>
>

yes, and what everyone is saying is "to do this you need to have cached
locally every artifact that the ivy-based build process downloads". This
can be done by
  -doing an online build
  -getting someone else to do an online build and getting a copy of
~/.ivy/cache off their box

That's it. There is no support for initial offline as the source tree
doesn't include all the dependencies.