Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ClassNotFoundException when loading a hbase table in mapreduce mode


Copy link to this message
-
Re: ClassNotFoundException when loading a hbase table in mapreduce mode
Hi Jack,

PIG_CLASSPATH doesn't ship jar files to the back-end, but it only adds them
to classpath in the front-end.

java.lang.ClassNotFoundException: com.google.protobuf.Message

You should make protobuf available in mappers in the back-end. Please try
to pass it via -Dpig.additional.jars=<path to protobuf jar> in your Pig
command. This will add the protobuf jar to distributed cache as well as
classpath in mappers.

Thanks,
Cheolsoo

On Tue, Nov 20, 2012 at 1:48 PM, Jinyuan Zhou <[EMAIL PROTECTED]>wrote:

> Hi,
> I am using org.apache.pig.backend.hadoop.hbase.HBaseStorage to load from
> hbase table in pig. it works in local mode. But when I was trying do it in
> mapreduce mode. The mappers got the CalssNotFoundException.
>
> [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2997: Unable to
> recreate exception from backed error: Error:
> java.lang.ClassNotFoundException: com.google.protobuf.Message
>
> I installed hadoop, hbase, hive through brew on my mac osx mountain lion.
> added hbase jar into PIG_CLASSPATH to be able to read load from hbase table
> i local mode. Seems I am still missing some
> Thanks,
> Jack
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB