Flume, mail # user - Re: Custom Serializer is not working

Custom Serializer is not working

JP 2012-08-03, 03:26

HI,

Im getting errros

2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc
started.
2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=>
/ localhost 41414 <http://10.105.39.202:41414>] OPEN
2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=>
/ localhost :41414 <http://10.105.39.202:41414>] BOUND: / localhost
:41414<http://10.105.39.202:41414>
2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost
:3770 <http://10.77.235.245:3770> => / localhost
:41414<http://10.105.39.202:41414>]
CONNECTED: / localhost :3770 <http://10.77.235.245:3770>
2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs://
localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable
to instantiate Builder from
org.apache.flume.serialization.CustomLogAvroEventSerializer
2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
java.io.IOException: java.lang.NullPointerException
   at
org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
   at
org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
   at
org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
   at
org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
   at
org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
   at
org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
   at
org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
   at
org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
   at
org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
   at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.NullPointerException
   at
org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
   at
org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
   ... 13 more
2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs://
localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable
to instantiate Builder from
org.apache.flume.serialization.CustomLogAvroEventSerializer
2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
java.io.IOException: java.lang.NullPointerException
   at
org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
   at
org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
   at
org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
   at
org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
   at
org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
   at
org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
   at
org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
   at
org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
   at
org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
   at
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
   at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
   at java.lang.Thread.run(Thread.java:662)

---------------------------------------------------------------------------------------------------------

This is my avro file

{ "type": "record", "name": "LogEvent", "namespace":
"org.apache.flume.serialization",
  "fields": [
   { "name": "srno", "type": "int" },
   { "name": "severity", "type": "int" },
   { "name": "timestamp", "type": "long" },
   { "name": "hostname", "type": "string" },
   { "name": "message", "type": "string" }
  ]
}
This is the LogEvent created using maven-avro and little customized

@SuppressWarnings("all")
public class LogEvent extends SpecificRecordBase implements SpecificRecord {
  public static final Schema _SCHEMA Schema.parse("{\"type\":\"record\",\"name\":\"LogEvent\",\"namespace\":\"org.apache.flume.serialization\",\"fields\":[{\"name\":\"srno\",\"type\":\"int\"},{\"name\":\"severity\",\"type\":\"int\"},{\"name\":\"timestamp\",\"type\":\"long\"},{\"name\":\"hostname\",\"type\":\"string\"},{\"name\":\"message\",\"type\":\"string\"}]}");
  public int srno;
  public String severity;
  public long timestamp;
  public String hostname;
  public String message;

  public Schema getSchema() { return _SCHEMA; }
  public Object get(int _field) {
   switch (_field) {
   case 0: return srno;
   case 1: return severity;
   case 2: return timestamp;
   case 3: return hostname;
   case 4: return message;
   default: throw new AvroRuntimeException("Bad index");
   }
  }

  @SuppressWarnings(value="unchecked")
  public void set(int _field, Object _value) {
   switch (_field) {
   case 0: srno = (Integer)_value; break;
   case 1: severity = (String)_value; break;
   case 2: timestamp = (Long)_value; break;
   case 3: hostname = (String)_value; break;
   case 4: message = (String)_value; break;
   default: throw new AvroRuntimeException("Bad index");
   }
  }

   public void setSrno(int srno) {
   this.srno = srno;
   }
   public void setSeverity(String s) {
   severity = s;
   }
   public String getSeverity() {
   return severity;
   }

   public void setTimestamp(long t) {
   timestamp = t;

Re: Custom Serializer is not working

Mubarak Seyed 2012-08-03, 03:35

Do you have a custom jar which contains org.apache.flume.serialization.CustomLogAvroEventSerializer in flume classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.

ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer

On Aug 2, 2012, at 8:26 PM, JP wrote:

> HI,
>
> Im getting errros
>
> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc started.
> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost 41414] OPEN
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost :41414] BOUND: / localhost :41414
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost:3770 => / localhost :41414] CONNECTED: / localhost :3770
> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
> at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
> at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
> at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
> at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.NullPointerException
> at org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
> ... 13 more
> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
> at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
> at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
> at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
> at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

Re: Custom Serializer is not working

JP 2012-08-03, 03:39

Thanks Mubarak,

I have added the jar to lib .

After that only im getting the exception.

Any help to resolve this issue.

On Fri, Aug 3, 2012 at 9:05 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:

> Do you have a custom jar which contains
> org.apache.flume.serialization.CustomLogAvroEventSerializer in flume
> classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.
>
> ERROR serialization.EventSerializerFactory: Unable to instantiate Builder
> from org.apache.flume.serialization.CustomLogAvroEventSerializer
>
> On Aug 2, 2012, at 8:26 PM, JP wrote:
>
> HI,
>
> Im getting errros
>
> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc
> started.
> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a,
> /localhost=> / localhost 41414 <http://10.105.39.202:41414/>] OPEN
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a,
> /localhost=> / localhost :41414 <http://10.105.39.202:41414/>] BOUND: /
> localhost :41414 <http://10.105.39.202:41414/>
> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost
> :3770 <http://10.77.235.245:3770/> => / localhost :41414<http://10.105.39.202:41414/>]
> CONNECTED: / localhost :3770 <http://10.77.235.245:3770/>
> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs://
> localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable
> to instantiate Builder from
> org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
> at
> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
> at
> org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
> at
> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
> at
> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
> at
> org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
> at
> org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
> at
> org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
> at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.NullPointerException
> at
> org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
> at
> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
> ... 13 more
> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs://
> localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable
> to instantiate Builder from
> org.apache.flume.serialization.CustomLogAvroEventSerializer
> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
> java.io.IOException: java.lang.NullPointerException
> at
> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
> at
> org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
> at
> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
> at
> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
> at
> org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
> at
> org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
> at
JP

Re: Custom Serializer is not working

Mubarak Seyed 2012-08-03, 03:53

can you please try with

>> agent2.sinks.loggerSink.serializer = org.apache.flume.serialization.CustomLogAvroEventSerializer$Builder

On Aug 2, 2012, at 8:39 PM, JP wrote:

> Thanks Mubarak,
>
> I have added the jar to lib .
>
> After that only im getting the exception.
>
> Any help to resolve this issue.
>
> On Fri, Aug 3, 2012 at 9:05 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:
> Do you have a custom jar which contains org.apache.flume.serialization.CustomLogAvroEventSerializer in flume classpath? You can copy the custom jar file to <FLUME_HOME>/lib directory.
>
> ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>
> On Aug 2, 2012, at 8:26 PM, JP wrote:
>
>> HI,
>>
>> Im getting errros
>>
>> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc started.
>> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost 41414] OPEN
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost=> / localhost :41414] BOUND: / localhost :41414
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost:3770 => / localhost :41414] CONNECTED: / localhost :3770
>> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
>> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>> at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>> at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>> at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>> at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>> at org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.lang.NullPointerException
>> at org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
>> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
>> ... 13 more
>> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs:// localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
>> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory: Unable to instantiate Builder from org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>> at org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>> at org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>> at org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>> at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>> at org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>> at org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)

Re: Custom Serializer is not working

JP 2012-08-03, 05:37

Thanks Mubarak it is working fine after adding

agent2.sinks.loggerSink.
serializer org.apache.flume.serialization.CustomLogAvroEventSerializer$Builder
On Fri, Aug 3, 2012 at 9:23 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:

> can you please try with
>
> agent2.sinks.loggerSink.serializer >> org.apache.flume.serialization.CustomLogAvroEventSerializer$Builder
>>
>>
> On Aug 2, 2012, at 8:39 PM, JP wrote:
>
> Thanks Mubarak,
>
> I have added the jar to lib .
>
> After that only im getting the exception.
>
> Any help to resolve this issue.
>
> On Fri, Aug 3, 2012 at 9:05 AM, Mubarak Seyed <[EMAIL PROTECTED]> wrote:
>
>> Do you have a custom jar which contains
>> org.apache.flume.serialization.CustomLogAvroEventSerializer in flume
>> classpath? You can copy the custom jar file to <FLUME_HOME>/libdirectory.
>>
>> ERROR serialization.EventSerializerFactory: Unable to instantiate Builder
>> from org.apache.flume.serialization.CustomLogAvroEventSerializer
>>
>> On Aug 2, 2012, at 8:26 PM, JP wrote:
>>
>> HI,
>>
>> Im getting errros
>>
>> 2012-08-02 16:58:50,065 INFO source.AvroSource: Avro source seqGenSrc
>> started.
>> 2012-08-02 16:59:02,463 INFO ipc.NettyServer: [id: 0x45cbda0a,
>> /localhost=> / localhost 41414 <http://10.105.39.202:41414/>] OPEN
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a,
>> /localhost=> / localhost :41414 <http://10.105.39.202:41414/>] BOUND: /
>> localhost :41414 <http://10.105.39.202:41414/>
>> 2012-08-02 16:59:02,466 INFO ipc.NettyServer: [id: 0x45cbda0a, /localhost
>> :3770 <http://10.77.235.245:3770/> => / localhost :41414<http://10.105.39.202:41414/>]
>> CONNECTED: / localhost :3770 <http://10.77.235.245:3770/>
>> 2012-08-02 16:59:04,006 INFO hdfs.BucketWriter: Creating hdfs://
>> localhost :8020/data/cssplogs/FlumeData.1343906943264.tmp
>> 2012-08-02 16:59:04,167 ERROR serialization.EventSerializerFactory:
>> Unable to instantiate Builder from
>> org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:04,168 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.access$000(BucketWriter.java:48)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:155)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter$1.run(BucketWriter.java:152)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:125)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.open(BucketWriter.java:152)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.append(BucketWriter.java:307)
>> at
>> org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:717)
>> at
>> org.apache.flume.sink.hdfs.HDFSEventSink$1.call(HDFSEventSink.java:714)
>> at
>> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: java.lang.NullPointerException
>> at
>> org.apache.flume.sink.hdfs.HDFSDataStream.open(HDFSDataStream.java:75)
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:188)
>> ... 13 more
>> 2012-08-02 16:59:05,239 INFO hdfs.BucketWriter: Creating hdfs://
>> localhost :8020/data/cssplogs/FlumeData.1343906943265.tmp
>> 2012-08-02 16:59:05,392 ERROR serialization.EventSerializerFactory:
>> Unable to instantiate Builder from
>> org.apache.flume.serialization.CustomLogAvroEventSerializer
>> 2012-08-02 16:59:05,392 WARN hdfs.HDFSEventSink: HDFS IO error
>> java.io.IOException: java.lang.NullPointerException
>> at
>> org.apache.flume.sink.hdfs.BucketWriter.doOpen(BucketWriter.java:202)
JP