Hello everybody:
     I was using the flume,but I set that a file is a event.
 But the event was always fail to send. Because I want to know the flume's size .
 Thank you very much!
 My Name
 Yanzhi Liu

Hi,

Are you asking how large of an event can flume handle? Do you have the
failure message?

Brock

On Mon, Aug 27, 2012 at 9:53 PM, Yanzhi.liu <[EMAIL PROTECTED]> wrote:

>   Hello everybody:
>     I was using the flume,but I set that a file is a event.
> But the event was always fail to send. Because I want to know the flume's
> size .
> Thank you very much!
> My Name
> Yanzhi Liu
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

hi Yanzhi,
   What's exception or failure log from your case. There is no size
limitation at Flume event.
   Wish your feedback with more information. Thanks

-Regards
Denny Ye

2012/8/28 Yanzhi.liu <[EMAIL PROTECTED]>

>   Hello everybody:
>     I was using the flume,but I set that a file is a event.
> But the event was always fail to send. Because I want to know the flume's
> size .
> Thank you very much!
> My Name
> Yanzhi Liu
>

Hello Denny:
     This is the wrong information:
 2012-08-28 11:24:37,308 ERROR flume.SinkRunner: Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to send events
        at org.apache.flume.sink.AvroSink.process(AvroSink.java:325)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
        at java.lang.Thread.run(Thread.java:662)
Caused by: org.apache.flume.EventDeliveryException: NettyAvroRpcClient { host: CMN-NJ-2-3C9, port: 4545 }: Failed to send batch
        at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:236)
        at org.apache.flume.sink.AvroSink.process(AvroSink.java:309)
        ... 3 more
Caused by: org.apache.flume.EventDeliveryException: NettyAvroRpcClient { host: CMN-NJ-2-3C9, port: 4545 }: Avro RPC call returned Status: FAILED
        at org.apache.flume.api.NettyAvroRpcClient.waitForStatusOK(NettyAvroRpcClient.java:312)
        at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:295)
        at org.apache.flume.api.NettyAvroRpcClient.appendBatch(NettyAvroRpcClient.java:224)
        ... 4 more
2012-08-28 11:24:42,312 INFO sink.AvroSink: Avro sink Sink-1: Building RpcClient with hostname: 221.130.18.211, port: 4545
 Thank you for helping!
 MyName
 Yanzhi Liu

  
  

 

 ------------------ Original ------------------
  From:  "Denny Ye"<[EMAIL PROTECTED]>;
 Date:  Tue, Aug 28, 2012 11:04 AM
 To:  "user"<[EMAIL PROTECTED]>;
 
 Subject:  Re: About event's size

 

hi Yanzhi,  What's exception or failure log from your case. There is no size limitation at Flume event.
 Wish your feedback with more information. Thanks
 

 -Regards
 Denny Ye
 
 2012/8/28 Yanzhi.liu <[EMAIL PROTECTED]>
      Hello everybody:
 I was using the flume,but I set that a file is a event.
 But the event was always fail to send. Because I want to know the flume's size .
 Thank you very much!
 My Name
 Yanzhi Liu

Hello:
     My event is bigger than 1MB.
 The event is a log file.
 At biggest it is 64MB or 128MB.
 Thank you very much.
 My Name
 Yanzhi Liu
  

  
  

 

 ------------------ Original ------------------
  From:  "Brock Noland"<[EMAIL PROTECTED]>;
 Date:  Tue, Aug 28, 2012 11:02 AM
 To:  "user"<[EMAIL PROTECTED]>;
 
 Subject:  Re: About event's size

 

Hi,

 Are you asking how large of an event can flume handle? Do you have the failure message?
 

 Brock

 On Mon, Aug 27, 2012 at 9:53 PM, Yanzhi.liu <[EMAIL PROTECTED]> wrote:
      Hello everybody:
 I was using the flume,but I set that a file is a event.
 But the event was always fail to send. Because I want to know the flume's size .
 Thank you very much!
 My Name
 Yanzhi Liu

  

 

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/

Generally "events" are going to be records in a log file. So a line or a
line + stack trace in the case of application logs.

Brock

On Tue, Aug 28, 2012 at 1:25 AM, Yanzhi.liu <[EMAIL PROTECTED]> wrote:

>   Hello:
>     My event is bigger than 1MB.
> The event is a log file.
> At biggest it is 64MB or 128MB.
> Thank you very much.
> My Name
> Yanzhi Liu
>
>  **
>
>
> ------------------ Original ------------------
>  *From: * "Brock Noland"<[EMAIL PROTECTED]>;
> *Date: * Tue, Aug 28, 2012 11:02 AM
> *To: * "user"<[EMAIL PROTECTED]>; **
>  *Subject: * Re: About event's size
>
> Hi,
>
> Are you asking how large of an event can flume handle? Do you have the
> failure message?
>
> Brock
>
> On Mon, Aug 27, 2012 at 9:53 PM, Yanzhi.liu <[EMAIL PROTECTED]> wrote:
>
>>   Hello everybody:
>> I was using the flume,but I set that a file is a event.
>> But the event was always fail to send. Because I want to know the flume's
>> size .
>> Thank you very much!
>> My Name
>> Yanzhi Liu
>>
>
>
>
> --
> Apache MRUnit - Unit testing MapReduce -
> http://incubator.apache.org/mrunit/
> **
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/