Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Custom Serializer is not working


+
JP 2012-08-03, 03:26
+
Mubarak Seyed 2012-08-03, 03:35
+
JP 2012-08-03, 03:39
Copy link to this message
-
Re: Custom Serializer is not working
can you please try with

>> agent2.sinks.loggerSink.serializer = org.apache.flume.serialization.CustomLogAvroEventSerializer$Builder

On Aug 2, 2012, at 8:39 PM, JP wrote:

> Thanks Mubarak,
>
> I have added the jar to lib .
>
> After that only im getting the exception.
>
> Any help to resolve this issue.
>
> On Fri, Aug 3, 2012 at 9:05 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:
> Do you have a custom jar which contains org.apache.flume.serialization.CustomLogAvroEventSerializer in flume classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.
>
> ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>
> On Aug 2, 2012, at 8:26 PM, JP wrote:
>
>> HI,
>>
>> Im getting errros
>>
>> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc started.
>> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost 41414] OPEN
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost :41414] BOUND: / localhost :41414
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost:3770 => / localhost :41414] CONNECTED: / localhost :3770
>> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
>> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>>         at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>>         at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>>         at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>>         at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
>>         ... 13 more
>> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
>> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>>         at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>>         at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>>         at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>>         at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>>         at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
+
JP 2012-08-03, 05:37
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB