-Re: File formats supported by flume
Paul Chavez 2014-02-14, 18:03
Excel and word, no, unless you wrote an application to process the data in those files and send events to Flume. CSV can be processed line by line using spoolDir source or the built in Avro client. I suppose you could export Excel data to CSV, though.
On Feb 13, 2014, at 10:34 PM, "Chhaya Vishwakarma" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Can I collect the data which is in word document ,excel or csv ?
From: Paul Chavez [mailto:[EMAIL PROTECTED]]
Sent: Friday, February 14, 2014 11:54 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: File formats supported by flume
Flume handles your data as discrete events, so it's 'file support' is a function of what you can deserialize into a flume event. Data sources do not have to be files, either. Applications can send events directly to flume using a variety of methods, and you can send events to message queues, search clusters and other data stores.
Here is a good overview:
On Feb 13, 2014, at 10:07 PM, "Chhaya Vishwakarma" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
I am using flume to collect logs. What are the other formats that flume supports apart from logs like excel, CSV and word doc etc. or it is limited to logs?
Can flume connect to relation database?
The contents of this e-mail and any attachment(s) may contain confidential or privileged information for the intended recipient(s). Unintended recipients are prohibited from taking action on the basis of information in this e-mail and using or disseminating the information, and must notify the sender and delete it from their system. L&T Infotech will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in this e-mail"