Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig 0.8.0 cassandra output


Copy link to this message
-
Re: Pig 0.8.0 cassandra output
Thanks. I was getting the same error

FYI also using Cloudera

On 3/29/11 9:32 AM, Matt Kennedy wrote:
> I had this same problem, it looks like this is not a great way to set the
> port number, instead, put this xml in your mapred-site.xml:
>
> <property>
>      <name>cassandra.thrift.port</name>
>      <value>9160</value>
>    </property>
>
>    <property>
>      <name>cassandra.thrift.address</name>
>      <value>localhost</value>
>    </property>
>
>    <property>
>      <name>cassandra.partitioner.class</name>
>      <value>org.apache.cassandra.dht.RandomPartitioner</value>
>    </property>
>
>
> On Wed, Mar 16, 2011 at 11:32 PM, Mark<[EMAIL PROTECTED]>  wrote:
>
>> Just trying to run simple example using pig 0.8.0 and Cloudera Hadoop CDH3.
>> I set all my PIG_X variables. Any idea what may be wrong?
>>
>> export PIG_RPC_PORT=9160
>> export PIG_INITIAL_ADDRESS=localhost
>> export PIG_PARTITIONER=org.apache.cassandra.dht.RandomPartitioner
>>
>> rows = load 'cassandra://Keyspace/MyColumnFamily/' USING
>> CassandraStorage();
>> dump rows;
>>
>> task_201103161955_0013_m_000000<
>> http://localhost:50030/taskdetails.jsp?jobid=job_201103161955_0013&tipid=task_201103161955_0013_m_000000>
>>   FAILED
>>
>> java.lang.NumberFormatException: null
>>         at java.lang.Integer.parseInt(Integer.java:417)
>>         at java.lang.Integer.parseInt(Integer.java:499)
>>         at
>> org.apache.cassandra.hadoop.ConfigHelper.getRpcPort(ConfigHelper.java:233)
>>         at
>> org.apache.cassandra.hadoop.pig.CassandraStorage.setConnectionInformation(Unknown
>> Source)
>>         at
>> org.apache.cassandra.hadoop.pig.CassandraStorage.setLocation(Unknown Source)
>>         at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:133)
>>         at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:111)
>>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:588)
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>>         at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>
>>
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB