Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Custom Serializer is not working


Copy link to this message
-
Re: Custom Serializer is not working
Do you have a custom jar which contains org.apache.flume.serialization.CustomLogAvroEventSerializer in flume classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.

ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer

On Aug 2, 2012, at 8:26 PM, JP wrote:

> HI,
>
> Im getting errros
>
> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc started.
> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost 41414] OPEN
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost :41414] BOUND: / localhost :41414
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost:3770 => / localhost :41414] CONNECTED: / localhost :3770
> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.NullPointerException
>         at org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
>         ... 13 more
> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB