Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig 0.8.0 cassandra output


Copy link to this message
-
Re: Pig 0.8.0 cassandra output
Thanks. I was getting the same error

FYI also using Cloudera

On 3/29/11 9:32 AM, Matt Kennedy wrote:
> I had this same problem, it looks like this is not a great way to set the
> port number, instead, put this xml in your mapred-site.xml:
>
> <property>
>      <name>cassandra.thrift.port</name>
>      <value>9160</value>
>    </property>
>
>    <property>
>      <name>cassandra.thrift.address</name>
>      <value>localhost</value>
>    </property>
>
>    <property>
>      <name>cassandra.partitioner.class</name>
>      <value>org.apache.cassandra.dht.RandomPartitioner</value>
>    </property>
>
>
> On Wed, Mar 16, 2011 at 11:32 PM, Mark<[EMAIL PROTECTED]>  wrote:
>
>> Just trying to run simple example using pig 0.8.0 and Cloudera Hadoop CDH3.
>> I set all my PIG_X variables. Any idea what may be wrong?
>>
>> export PIG_RPC_PORT=9160
>> export PIG_INITIAL_ADDRESS=localhost
>> export PIG_PARTITIONER=org.apache.cassandra.dht.RandomPartitioner
>>
>> rows = load 'cassandra://Keyspace/MyColumnFamily/' USING
>> CassandraStorage();
>> dump rows;
>>
>> task_201103161955_0013_m_000000<
>> http://localhost:50030/taskdetails.jsp?jobid=job_201103161955_0013&tipid=task_201103161955_0013_m_000000>
>>   FAILED
>>
>> java.lang.NumberFormatException: null
>>         at java.lang.Integer.parseInt(Integer.java:417)
>>         at java.lang.Integer.parseInt(Integer.java:499)
>>         at
>> org.apache.cassandra.hadoop.ConfigHelper.getRpcPort(ConfigHelper.java:233)
>>         at
>> org.apache.cassandra.hadoop.pig.CassandraStorage.setConnectionInformation(Unknown
>> Source)
>>         at
>> org.apache.cassandra.hadoop.pig.CassandraStorage.setLocation(Unknown Source)
>>         at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.mergeSplitSpecificConf(PigInputFormat.java:133)
>>         at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.createRecordReader(PigInputFormat.java:111)
>>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:588)
>>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
>>         at org.apache.hadoop.mapred.Child.main(Child.java:170)
>>
>>
>>