Hello list! I am new here, I am trying to add Pig on a Hadoop cluster.

I have no idea how to make code Pig, I am system administrator. We have
10 node cluster with Hadoop and we use it with Nutch.

Can someone help to install Pig on it?

Thanks and best regards.

--
Josu Lazkano <[EMAIL PROTECTED]>

On Wed, Oct 19, 2011 at 10:10 AM, Josu Lazkano <
[EMAIL PROTECTED]> wrote:

> Hello list! I am new here, I am trying to add Pig on a Hadoop cluster.
>
> I have no idea how to make code Pig, I am system administrator. We have
> 10 node cluster with Hadoop and we use it with Nutch.
>
> Can someone help to install Pig on it?
>

Check out: http://pig.apache.org/docs/r0.9.1/start.html

Best regards,
Amund Tveit
http://atbrox.com/about/
>
> Thanks and best regards.
>
> --
> Josu Lazkano <[EMAIL PROTECTED]>
>
>
>
--
http://atbrox.com - +47 416 26 572

> On Wed, Oct 19, 2011 at 10:10 AM, Josu Lazkano <
> [EMAIL PROTECTED]> wrote:
>
> > Hello list! I am new here, I am trying to add Pig on a Hadoop cluster.
> >
> > I have no idea how to make code Pig, I am system administrator. We have
> > 10 node cluster with Hadoop and we use it with Nutch.
> >
> > Can someone help to install Pig on it?
> >
>
> Check out: http://pig.apache.org/docs/r0.9.1/start.html
>
> Best regards,
> Amund Tveit
> http://atbrox.com/about/
>
>
>
>
> >
> > Thanks and best regards.
> >
> > --
> > Josu Lazkano <[EMAIL PROTECTED]>
> >
> >
> >
>
>

Thanks Amund, I try the link, I make this steps:

cd /usr/local/hadoop/
sudo wget http://apache.rediris.es/pig/pig-0.9.1/pig-0.9.1.tar.gz
sudo tar xzf pig-0.9.1.tar.gz
sudo mv pig-0.9.1 pig
sudo chown -R hduser:hadoop pig
su hduser

This where I have hadoop and nuch:

$ tree -L 1 /usr/local/hadoop
/usr/local/hadoop
├── bin
├── build.xml
├── c++
├── CHANGES.txt
├── conf
├── contrib
├── docs
├── hadoop-0.20.2-ant.jar
├── hadoop-0.20.2-core.jar
├── hadoop-0.20.2-examples.jar
├── hadoop-0.20.2-test.jar
├── hadoop-0.20.2-tools.jar
├── ivy
├── ivy.xml
├── lib
├── librecordio
├── LICENSE.txt
├── logs
├── NOTICE.txt
├── nutch-1.2.jar
├── nutch-1.2.job
├── nutch-1.2.war
├── pig
├── pig-0.9.1.tar.gz
├── README.txt
├── src
└── webapps
I have the hadoop and nutch binaries on bin/ and the config on conf/.

Must I move the pig binari and the config files to same place?

Thanks for your great help, best regards.

 
--
Josu Lazkano

On 10/20/11 4:19 AM, Josu Lazkano wrote:

>
>
> I have the hadoop and nutch binaries on bin/ and the config on conf/.
>

  set HADOOP_HOME to dir containing bin/hadoop (/usr/local/hadoop ?),
and add hadoop conf dir to PIG_CLASSPATH (/usr/local/hadoop/conf ? ).

The doc talks about setting HADOOP_CONF_DIR, but that doesn't seem to
get used by pig. But I think it makes sense to fix pig to do that
(rather than change the doc). I will create a jira.

-Thejas