Hi

I'd like to know when 1.3 is scheduled to be released, I'm waiting for the
fix for FLUME-1573 <../../../jira/browse/FLUME-1573>

I'm using flume 1.2 and have multiple hdfs sinks writing into the same
directory and I'm getting the following exception regularly

2012-09-21 16:26:50,567  WARN
[SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS
IO error
java.io.IOException: Callable timed out
    at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
    at
org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
    at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
    at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
    at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
    at java.lang.Thread.run(Thread.java:662)
Caused by: java.util.concurrent.TimeoutException
    at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
    at java.util.concurrent.FutureTask.get(FutureTask.java:91)
    at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
    ... 5 more
2012-09-21 16:26:50,753  WARN
[SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS
IO error
java.io.IOException: Callable timed out
    at
org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)

--
Rgds
Ray

As of now, there is no immediate timeline for Flume-1.3.0. Please bring it up once this patch is committed - we can discuss it at that time.
Thanks
Hari

--
Hari Shreedharan
On Monday, September 24, 2012 at 7:47 AM, Raymond Ng wrote:

> Hi
>
> I'd like to know when 1.3 is scheduled to be released, I'm waiting for the fix for FLUME-1573 (../../../jira/browse/FLUME-1573)
>
> I'm using flume 1.2 and have multiple hdfs sinks writing into the same directory and I'm getting the following exception regularly
>
> 2012-09-21 16:26:50,567  WARN [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO error
> java.io.IOException: Callable timed out
>     at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>     at org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
>     at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
>     at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>     at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>     at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.TimeoutException
>     at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
>     at java.util.concurrent.FutureTask.get(FutureTask.java:91)
>     at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
>     ... 5 more
> 2012-09-21 16:26:50,753  WARN [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO error
> java.io.IOException: Callable timed out
>     at org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>
> --
> Rgds
> Ray

I was thinking of starting proposing a 1.3 release and volunteering to
be the RM. It would still be sometime before there was a 1.3 release
if all went well. I'll get that thread started on the dev@ list.

On Mon, Sep 24, 2012 at 1:22 PM, Hari Shreedharan
<[EMAIL PROTECTED]> wrote:
> As of now, there is no immediate timeline for Flume-1.3.0. Please bring it
> up once this patch is committed - we can discuss it at that time.
>
>
> Thanks
> Hari
>
> --
> Hari Shreedharan
>
> On Monday, September 24, 2012 at 7:47 AM, Raymond Ng wrote:
>
> Hi
>
> I'd like to know when 1.3 is scheduled to be released, I'm waiting for the
> fix for FLUME-1573
>
> I'm using flume 1.2 and have multiple hdfs sinks writing into the same
> directory and I'm getting the following exception regularly
>
> 2012-09-21 16:26:50,567  WARN
> [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO
> error
> java.io.IOException: Callable timed out
>     at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>     at
> org.apache.flume.sink.hdfs.HDFSEventSink.append(HDFSEventSink.java:714)
>     at
> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:412)
>     at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>     at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>     at java.lang.Thread.run(Thread.java:662)
> Caused by: java.util.concurrent.TimeoutException
>     at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:228)
>     at java.util.concurrent.FutureTask.get(FutureTask.java:91)
>     at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:336)
>     ... 5 more
> 2012-09-21 16:26:50,753  WARN
> [SinkRunner-PollingRunner-DefaultSinkProcessor] HDFSEventSink.java - HDFS IO
> error
> java.io.IOException: Callable timed out
>     at
> org.apache.flume.sink.hdfs.HDFSEventSink.callWithTimeout(HDFSEventSink.java:343)
>
> --
> Rgds
> Ray
>
>

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/