Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Verifying Pig -> Hadoop connection


+
Dave Viner 2010-07-01, 06:00
Copy link to this message
-
Re: Verifying Pig -> Hadoop connection
Yep, you need the PIG_CLASSPATH environment variable set to your
hadoop's conf directory.

$ export PIG_CLASSPATH=/etc/hadoop-0.20.2/conf
$ pig
2010-07-01 14:10:30,221 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine -
Connecting to hadoop file system at: hdfs://yourmaster:9000
(...)
On Thu, Jul 1, 2010 at 11:30 AM, Dave Viner <[EMAIL PROTECTED]> wrote:
> Whenever I start up pig from the commandline, I see the same message from
> both -x local and -x mapreduce:
>
> [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine
> - Connecting to hadoop file system at: file:///
>
> Somehow, that feels like it's not connecting to my running Hadoop cluster.
>  Is there some way to verify that Pig is talking to my Hadoop cluster?  Is
> there some additional setting that I need to use in order to "point" Pig to
> my Hadoop cluster?
>
> Thanks
> Dave Viner
>

--
Harsh J
www.harshj.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB