Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Different behaviour with same Pig Version


Copy link to this message
-
Re: Different behaviour with same Pig Version
This blog post describes some of this behavior
http://hadoopified.wordpress.com/2013/04/07/pig-startup-script-behavior/
On Mon, May 6, 2013 at 1:07 AM, <[EMAIL PROTECTED]> wrote:

> forget it ! It came from hadoop-env.sh provided by the package I installed
> on one cluster :(
>
> Regards
> --
> Cyril SCETBON
>
> On May 3, 2013, at 11:44 AM, [EMAIL PROTECTED]<mailto:
> [EMAIL PROTECTED]> wrote:
>
> Hi,
>
> I have 2 differents behaviour for the same Pig version (with hadoop 1.1.2)
> on different servers. If anyone can tell me why with the same versions and
> the same parameters I don't have the same behaviour. I'm trying to set the
> builtin import list but it's not used with one hadoop cluster whereas it's
> used when I use it on a single node cluster :
>
> + PIG_OPTS=' -Dudf.import.list=org.apache.cassandra.hadoop.pig
> -Dpig.additional.jars=/usr/local/Cellar/cassandra/1.2.4/apache-cassandra-thrift-1.2.4.jar:/usr/local/Cellar/cassandra/1.2.4/libthrift-0.7.0.jar
> -Dpig.log.dir=/usr/local/bin/../Cellar/pig/0.11.1/bin/../logs'
> + PIG_OPTS=' -Dudf.import.list=org.apache.cassandra.hadoop.pig
> -Dpig.additional.jars=/usr/local/Cellar/cassandra/1.2.4/apache-cassandra-thrift-1.2.4.jar:/usr/local/Cellar/cassandra/1.2.4/libthrift-0.7.0.jar
> -Dpig.log.dir=/usr/local/bin/../Cellar/pig/0.11.1/bin/../logs
> -Dpig.log.file=pig.log'
> + PIG_OPTS=' -Dudf.import.list=org.apache.cassandra.hadoop.pig
> -Dpig.additional.jars=/usr/local/Cellar/cassandra/1.2.4/apache-cassandra-thrift-1.2.4.jar:/usr/local/Cellar/cassandra/1.2.4/libthrift-0.7.0.jar
> -Dpig.log.dir=/usr/local/bin/../Cellar/pig/0.11.1/bin/../logs
> -Dpig.log.file=pig.log
> -Dpig.home.dir=/usr/local/bin/../Cellar/pig/0.11.1/bin/..'
> + '[' '' == true ']'
> + '[' -n /usr/local/bin/hadoop ']'
> + '[' false == true ']'
> + '[' -f /usr/local/bin/../Cellar/pig/0.11.1/bin/../pig-withouthadoop.jar
> ']'
> ++ echo
> /usr/local/bin/../Cellar/pig/0.11.1/bin/../pig-0.11.1-withouthadoop.jar
> +
> PIG_JAR=/usr/local/bin/../Cellar/pig/0.11.1/bin/../pig-0.11.1-withouthadoop.jar
> + '[' -z
> /usr/local/bin/../Cellar/pig/0.11.1/bin/../pig-0.11.1-withouthadoop.jar ']'
> + '[' -n
> /usr/local/bin/../Cellar/pig/0.11.1/bin/../pig-0.11.1-withouthadoop.jar ']'
> +
> CLASSPATH='/etc/hadoop/conf:/usr/lib/jvm/java-7-oracle/lib/tools.jar:::/opt/apache-cassandra-1.2.3/lib/*:/usr/share/hadoop/lib/*:/opt/pig-0.11.1/pig-0.11.1-withouthadoop.jar:/etc/hadoop:/opt/pig-0.11.1/bin/../lib/jython-standalone-2.5.3.jar:/opt/pig-0.11.1/bin/../pig-0.11.1-withouthadoop.jar'
> + export
> 'HADOOP_CLASSPATH=/etc/hadoop/conf:/usr/lib/jvm/java-7-oracle/lib/tools.jar:::/opt/apache-cassandra-1.2.3/lib/*:/usr/share/hadoop/lib/*:/opt/pig-0.11.1/pig-0.11.1-withouthadoop.jar:/etc/hadoop:/opt/pig-0.11.1/bin/../lib/jython-standalone-2.5.3.jar:/opt/pig-0.11.1/bin/../pig-0.11.1-withouthadoop.jar:'
> +
> HADOOP_CLASSPATH='/etc/hadoop/conf:/usr/lib/jvm/java-7-oracle/lib/tools.jar:::/opt/apache-cassandra-1.2.3/lib/*:/usr/share/hadoop/lib/*:/opt/pig-0.11.1/pig-0.11.1-withouthadoop.jar:/etc/hadoop:/opt/pig-0.11.1/bin/../lib/jython-standalone-2.5.3.jar:/opt/pig-0.11.1/bin/../pig-0.11.1-withouthadoop.jar:'
> + export 'HADOOP_OPTS=-Xmx1000m
>  -Dudf.import.list=org.apache.cassandra.hadoop.pig
> -Dpig.additional.jars=/opt/apache-cassandra-1.2.3/lib/apache-cassandra-thrift-1.2.3.jar:/opt/apache-cassandra-1.2.3/lib/libthrift-0.7.0.jar
> -4 log4j.properties -Dpig.log.dir=/opt/pig-0.11.1/bin/../logs
> -Dpig.log.file=pig.log -Dpig.home.dir=/opt/pig-0.11.1/bin/..
> -Djava.net.preferIPv4Stack=true '
> + HADOOP_OPTS='-Xmx1000m
>  -Dudf.import.list=org.apache.cassandra.hadoop.pig
> -Dpig.additional.jars=/opt/apache-cassandra-1.2.3/lib/apache-cassandra-thrift-1.2.3.jar:/opt/apache-cassandra-1.2.3/lib/libthrift-0.7.0.jar
> -4 log4j.properties -Dpig.log.dir=/opt/pig-0.11.1/bin/../logs
> -Dpig.log.file=pig.log -Dpig.home.dir=/opt/pig-0.11.1/bin/..
> -Djava.net.preferIPv4Stack=true '
> + '[' false == true ']'
> + exec /usr/bin/hadoop jar
> /opt/pig-0.11.1/bin/../pig-0.11.1-withouthadoop.jar ./hadoop-sum-value_1.pig
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB