Hey there,

I'm wondering if anyone has put logstash and kafka together?  I want to be
able to have a good searchable interface to my logs that I intend to have
go through kafka.

If you haven't used logstash, are there any other suggestions for an web
based interface to search and/or do analytics with the logs?

Thanks in advance!

Hi,

I did a POC using Graylog,

I changed the indexing policy of graylog (using grules),

And than I made my logs searchable,
On 10/22/2012 06:08 PM, Taylor Gautier wrote:
> Hey there,
>
> I'm wondering if anyone has put logstash and kafka together?  I want to be
> able to have a good searchable interface to my logs that I intend to have
> go through kafka.
>
> If you haven't used logstash, are there any other suggestions for an web
> based interface to search and/or do analytics with the logs?
>
> Thanks in advance!

At LinkedIn, we use Sensei DB which is a distributed, real-time
database that allows you to plug various gateways for indexing. One of
these gateways is Kafka. This allows you to search the logs that are
sent to Kafka in a semi-structured manner.

http://engineering.linkedin.com/open-source/introducing-senseidb-10-open-source-distributed-realtime-semi-structured-database

Thanks,
Neha

On Mon, Oct 22, 2012 at 9:13 AM, Guy Doulberg <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I did a POC using Graylog,
>
> I changed the indexing policy of graylog (using grules),
>
> And than I made my logs searchable,
>
>
>
> On 10/22/2012 06:08 PM, Taylor Gautier wrote:
>>
>> Hey there,
>>
>> I'm wondering if anyone has put logstash and kafka together?  I want to be
>> able to have a good searchable interface to my logs that I intend to have
>> go through kafka.
>>
>> If you haven't used logstash, are there any other suggestions for an web
>> based interface to search and/or do analytics with the logs?
>>
>> Thanks in advance!
>
>