Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Re: File formats supported by flume


+
Paul Chavez 2014-02-14, 06:24
+
Ados1984 2014-02-14, 06:10
Copy link to this message
-
Re: File formats supported by flume
Excel and word, no, unless you wrote an application to process the data in those files and send events to Flume. CSV can be processed line by line using spoolDir source or the built in Avro client. I suppose you could export Excel data to CSV, though.

On Feb 13, 2014, at 10:34 PM, "Chhaya Vishwakarma" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:

Ok
Can I collect the data which is in word document ,excel or csv ?

From: Paul Chavez [mailto:[EMAIL PROTECTED]]
Sent: Friday, February 14, 2014 11:54 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: File formats supported by flume

Flume handles your data as discrete events, so it's 'file support' is a function of what you can deserialize into a flume event. Data sources do not have to be files, either. Applications can send events directly to flume using a variety of methods, and you can send events to message queues, search clusters and other data stores.

Here is a good overview:
http://flume.apache.org/FlumeUserGuide.html#architecture

-paul

On Feb 13, 2014, at 10:07 PM, "Chhaya Vishwakarma" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,
I am using flume to collect logs. What are the other formats that flume supports apart from logs like excel, CSV and word doc etc. or it is limited to logs?

Can flume connect to relation database?
Regards,
Chhaya Vishwakarma
________________________________
The contents of this e-mail and any attachment(s) may contain confidential or privileged information for the intended recipient(s). Unintended recipients are prohibited from taking action on the basis of information in this e-mail and using or disseminating the information, and must notify the sender and delete it from their system. L&T Infotech will not accept responsibility or liability for the accuracy or completeness of, or the presence of any virus or disabling code in this e-mail"

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB