Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # dev >> [NEW FEATURE] - FLUME-1687 - Solr Sink for Apache Flume Now In Beta


+
Israel Ekpo 2013-04-20, 17:43
Copy link to this message
-
Re: [NEW FEATURE] - FLUME-1687 - Solr Sink for Apache Flume Now In Beta
Israel,
Nice! I'll find some time to dig into your patch this week.

Regards,
Mike

On Sat, Apr 20, 2013 at 10:43 AM, Israel Ekpo <[EMAIL PROTECTED]> wrote:

> Fellow Flume Users,
>
> I have just created an Apache Solr sink for Flume against version 1.3.1
>
> This has been tested and it works fine.
>
> This sink is a great alternative to the ElasticSearchSink.
>
> There are some flume users that have experience with Apache Solr but do not
> necessarily understand how to get ElasticSearch up and running.
>
> Having a SolrSink as an alternative could be very helpful in creating a
> user interface for searching through event and log data collected with
> Flume using Apache Solr.
>
> This sink essentially picks up events from the channel and uses the
> ConcurrentUpdateSolrServer client from SolrJ to send events in batches as
> SolrInputDocuments using multipe worker threads to Apache Solr.
>
> The number of documents/events per batch and the number of worker threads
> can be configured.
>
> There is a default serializer as well.
>
> If you have the chance please try it out and let me know what you think.
>
> It would be great to gather some feedback from users before finalizing the
> features and configuration options for this sink.
>
> Instructions are available here on how to set up and configure this sink.
>
>
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Setup+Solr+Sink+for+Flume
>
> JAR files for the feature as well as its dependencies are available here
>
> https://issues.apache.org/jira/browse/FLUME-1687
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB