Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Re: The most newbie question ever


+
Keith Thomas 2013-03-22, 00:44
Copy link to this message
-
Re: The most newbie question ever
Harsh J 2013-03-22, 05:19
You've downloaded a binary inclusive release and can just start using
it after configuring it. Mark the extracted path as HADOOP_PREFIX, and
look at $HADOOP_PREFIX/etc/hadoop/ for the config files. Run HDFS and
YARN via the $HADOOP_PREFIX/sbin/start-{dfs,yarn}.sh scripts, and of
course place $HADOOP_PREFIX/bin/ on your PATH.

If you instead prefer installing 2.x RPMs or DEBs, head over to the
Apache Bigtop project at http://bigtop.apache.org to find the rpm/deb
scripts and perhaps also packages from other builders.

Out of the box, for 2.0.3, you may also have to configure the
CapacityScheduler (since its the default now) to be able to run the
YARN services.

On Fri, Mar 22, 2013 at 6:14 AM, Keith Thomas <[EMAIL PROTECTED]> wrote:
> I have not checked out the source code. I have downloaded the following file
>
> hadoop-2.0.3-alpha.tar.gz         07-Feb-2013 03:48   89M
>
> unzipped it and now I'm trying to find the installation instructions.
>
> -Keith
>
>
> On Thu, Mar 21, 2013 at 5:41 PM, Hitesh Shah <[EMAIL PROTECTED]> wrote:
>>
>> Also, BUILDING.txt can be found at the top level directory of the checked
>> out code.
>>
>> -- Hitesh
>>
>> On Mar 21, 2013, at 5:39 PM, Hitesh Shah wrote:
>>
>> > Assuming you have checked out the hadoop source code into
>> > /home/keithomas/hadoop-common/ , you need to run the maven command in that
>> > directory and not from /home/keithomas/
>> >
>> > -- Hitesh
>> >
>> >
>> > On Mar 21, 2013, at 5:20 PM, Keith Thomas wrote:
>> >
>> >> Thank you for your help Mayank. I managed to google for BUILDING.TXT
>> >> and discovered I need maven3. I installed maven3.
>> >>
>> >> When I enter the command on the getting started link you sent me this
>> >> happens,
>> >>
>> >> keithomas@ubuntu:~$ mvn clean install -DskipTests
>> >> [INFO] Scanning for projects...
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [INFO] BUILD FAILURE
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [INFO] Total time: 0.119s
>> >> [INFO] Finished at: Thu Mar 21 17:14:39 PDT 2013
>> >> [INFO] Final Memory: 3M/247M
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [ERROR] The goal you specified requires a project to execute but there
>> >> is no POM in this directory (/home/keithomas). Please verify you invoked
>> >> Maven from the correct directory. -> [Help 1]
>> >>
>> >> and when I enter the command you kindly sent this happens,
>> >>
>> >> keithomas@ubuntu:~$ mvn package -Pdist -DskipTests -Dtar
>> >> [INFO] Scanning for projects...
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [INFO] BUILD FAILURE
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [INFO] Total time: 0.114s
>> >> [INFO] Finished at: Thu Mar 21 17:15:11 PDT 2013
>> >> [INFO] Final Memory: 3M/247M
>> >> [INFO]
>> >> ------------------------------------------------------------------------
>> >> [WARNING] The requested profile "dist" could not be activated because
>> >> it does not exist.
>> >> [ERROR] The goal you specified requires a project to execute but there
>> >> is no POM in this directory (/home/keithomas). Please verify you invoked
>> >> Maven from the correct directory. -> [Help 1]
>> >> [ERROR]
>> >>
>> >>
>> >> On Thu, Mar 21, 2013 at 4:38 PM, Mayank Bansal <[EMAIL PROTECTED]>
>> >> wrote:
>> >> There is a BUILDING.txt
>> >>
>> >> $ mvn package -Pdist -DskipTests -Dtar
>> >>
>> >> Thanks,
>> >> Mayank
>> >>
>> >> On Thu, Mar 21, 2013 at 4:35 PM, Keith Thomas <[EMAIL PROTECTED]>
>> >> wrote:
>> >>> Thanks for the great link but sorry it looks like this is going to be
>> >>> a long
>> >>> process.
>> >>>
>> >>> Step 1 is: mvn clean install -DskipTests
>> >>>
>> >>> First of all my OS tells me I need maven but it gives me two choices,
>> >>> maven
>> >>> and maven 2.
>> >>>
>> >>> Is there any pre-req info for Hadoop? I've previously guessed I should

Harsh J
+
Keith Thomas 2013-03-21, 23:35
+
Mayank Bansal 2013-03-21, 23:38