Hi,,,
I want to know is it possible to load the zip file from remote location to
the hdfs sink in flume-ng-1.2

Thanks in advance,
Priyanka

priyanka,
you can do that flume-ng-1.3 using directory spooling

just be aware what kind of channel you use
On Fri, Feb 8, 2013 at 10:06 PM, Priyanka Jain
<[EMAIL PROTECTED]>wrote:

> Hi,,,
> I want to know is it possible to load the zip file from remote location to
> the hdfs sink in flume-ng-1.2
>
> Thanks in advance,
> Priyanka
>

--
Nitin Pawar

Actually it might be tricky to use the directory spooling source to read a
compressed archive. It's possible, but you would definitely need to write
your own deserializer.

Flume is an event-oriented streaming system, it's not really optimized to
be a plain file transfer mechanism like FTP.

Regards,
Mike
On Fri, Feb 8, 2013 at 9:03 AM, Nitin Pawar <[EMAIL PROTECTED]> wrote:

> priyanka,
> you can do that flume-ng-1.3 using directory spooling
>
> just be aware what kind of channel you use
>
>
> On Fri, Feb 8, 2013 at 10:06 PM, Priyanka Jain <[EMAIL PROTECTED]
> > wrote:
>
>> Hi,,,
>> I want to know is it possible to load the zip file from remote location
>> to the hdfs sink in flume-ng-1.2
>>
>> Thanks in advance,
>> Priyanka
>>
>
>
>
> --
> Nitin Pawar
>