Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Custom Serializer is not working


Copy link to this message
-
Re: Custom Serializer is not working
can you please try with

>> agent2.sinks.loggerSink.serializer = org.apache.flume.serialization.CustomLogAvroEventSerializer$Builder

On Aug 2, 2012, at 8:39 PM, JP wrote:

> Thanks Mubarak,
>
> I have added the jar to lib .
>
> After that only im getting the exception.
>
> Any help to resolve this issue.
>
> On Fri, Aug 3, 2012 at 9:05 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:
> Do you have a custom jar which contains org.apache.flume.serialization.CustomLogAvroEventSerializer in flume classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.
>
> ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>
> On Aug 2, 2012, at 8:26 PM, JP wrote:
>
>> HI,
>>
>> Im getting errros
>>
>> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc started.
>> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost 41414] OPEN
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost :41414] BOUND: / localhost :41414
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost:3770 => / localhost :41414] CONNECTED: / localhost :3770
>> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
>> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>         at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
>>         ... 13 more
>> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
>> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)