Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Problem with a protobuf in EB


+
Kris Coward 2011-04-29, 18:38
+
Dmitriy Ryaboy 2011-04-29, 20:00
+
Kris Coward 2011-04-29, 20:15
+
Dmitriy Ryaboy 2011-04-29, 23:16
Copy link to this message
-
Re: Problem with a protobuf in EB

Here we go:

META-INF/
META-INF/MANIFEST.MF
com/work/logs/LogFormat$1.class
com/work/logs/LogFormat$Apa$Builder.class
com/work/logs/LogFormat$Apa.class
com/work/logs/LogFormat.class
com/work/logs/LogFormat$Cpu$Builder.class
com/work/logs/LogFormat$Cpu.class
com/work/logs/LogFormat$Evt$Builder.class
com/work/logs/LogFormat$Evt.class
com/work/logs/LogFormat$FirstMsg$Builder.class
com/work/logs/LogFormat$FirstMsg.class
com/work/logs/LogFormat$Gci$Builder.class
com/work/logs/LogFormat$Gci.class
com/work/logs/LogFormat$Inr$Builder.class
com/work/logs/LogFormat$Inr.class
com/work/logs/LogFormat$Ins$Builder.class
com/work/logs/LogFormat$Ins.class
com/work/logs/LogFormat$Mer$Builder.class
com/work/logs/LogFormat$Mer.class
com/work/logs/LogFormat$Mes$Builder.class
com/work/logs/LogFormat$Mes.class
com/work/logs/LogFormat$Mtu$Builder.class
com/work/logs/LogFormat$Mtu.class
com/work/logs/LogFormat$Nei$Builder.class
com/work/logs/LogFormat$Nei.class
com/work/logs/LogFormat$Nes$Builder.class
com/work/logs/LogFormat$Nes.class
com/work/logs/LogFormat$Ntr$Builder.class
com/work/logs/LogFormat$Ntr.class
com/work/logs/LogFormat$Nts$Builder.class
com/work/logs/LogFormat$Nts.class
com/work/logs/LogFormat$Pgr$Builder.class
com/work/logs/LogFormat$Pgr.class
com/work/logs/LogFormat$Psr$Builder.class
com/work/logs/LogFormat$Psr.class
com/work/logs/LogFormat$Pst$Builder.class
com/work/logs/LogFormat$Pst.class
com/work/logs/LogFormat$Ucc$Builder.class
com/work/logs/LogFormat$Ucc.class

On Fri, Apr 29, 2011 at 04:16:05PM -0700, Dmitriy Ryaboy wrote:
> and the contents of '/home/kris/swineflu/logformats-0.1.2.jar'  (jar -tf)
>
> D
>
> On Fri, Apr 29, 2011 at 1:15 PM, Kris Coward <[EMAIL PROTECTED]> wrote:
>
> >
> > Well I'll send up to the point where it fails and exits, since the rest
> > seems kinda superfluous.. here it is:
> >
> > REGISTER '/usr/local/hadoopgpl/lib/slf4j-api-1.5.8.jar'
> > REGISTER '/usr/local/hadoopgpl/lib/slf4j-log4j12-1.5.10.jar'
> > REGISTER '/usr/local/pig/lib/elephant-bird.jar'
> > REGISTER '/usr/local/pig/lib/hadoop-lzo.jar'
> > REGISTER '/usr/local/pig/lib/piggybank.jar'
> > REGISTER '/usr/local/pig/lib/jackson-core-asl-1.0.1.jar'
> > REGISTER '/usr/local/pig/lib/jackson-mapper-asl-1.0.1.jar'
> > REGISTER '/usr/local/pig/lib/jsp-2.1-6.1.4.jar'
> > REGISTER '/home/kris/swineflu/com.kontagent.swineflu.jar'
> > REGISTER '/home/kris/swineflu/logformats-0.1.2.jar'
> >
> > %declare storage
> > com.twitter.elephantbird.pig.proto.LzoProtobuffB64LinePigStore
> > %declare loader
> > com.twitter.elephantbird.pig.proto.LzoProtobuffB64LinePigStore
> >
> > -- load the raw data from HDFS
> > apaNew = LOAD '$infile/apa' USING $loader('apa');
> > apaTable = LOAD '$firstfile/apa' USING $loader('firstp');
> >
> >
> > (where $infile and $firstfile are passed as parameters at runtime, and
> > the files were tested as existing)
> >
> > Cheers,
> > Kris
> >
> > On Fri, Apr 29, 2011 at 01:00:55PM -0700, Dmitriy Ryaboy wrote:
> > > Odd.. can you send the full pig script including the register statements?
> > >
> > > On Fri, Apr 29, 2011 at 11:38 AM, Kris Coward <[EMAIL PROTECTED]> wrote:
> > >
> > > >
> > > > So I've recently added a protocol/schema to a collection I got from
> > > > someone else, recompiled it, and added it to my scripts and am having
> > > > problems.
> > > >
> > > > More specifically, it built just fine, and when REGISTERed in the
> > script
> > > > that uses it to store a relation, it seems to work fine, but when I try
> > > > to use it to read that same relation back, I get the error:
> > > >
> > > > [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected
> > > > internal error. Error instantiating com.work.logs.LogFormat$FirstMsg
> > > > referred to by firstp
> > > >
> > > > With a stack trace of:
> > > >
> > > > java.lang.RuntimeException: Error instantiating
> > > > com.work.logs.LogFormat$FirstMsg referred to by firstp
> > > >        at
> > > >
> > com.twitter.elephantbird.pig.proto.ProtobufClassUtil.loadProtoClass(Unknown

Kris Coward http://unripe.melon.org/
GPG Fingerprint: 2BF3 957D 310A FEEC 4733  830E 21A4 05C7 1FEB 12B3
+
Gerrit Jansen van Vuuren 2011-04-30, 00:11
+
Dmitriy Ryaboy 2011-05-02, 00:27
+
Gerrit Jansen van Vuuren 2011-05-02, 08:43
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB