Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 20 (0.371s).
Loading phrases to help you
refine your search...
[BLUR-387] Blur Spark Connector - Blur - [issue]
...Integrate Apache BLUR with Spark Streaming / Spark ....
http://issues.apache.org/jira/browse/BLUR-387    Author: Dibyendu Bhattacharya, 2014-10-22, 16:47
Re: All-time stream re-processing - Spark - [mail # dev]
...So you have a single Kafka topic which has very high retention period (that decides the storage capacity of a given Kafka topic) and you want toprocess all historical data first using Camus ...
   Author: Dibyendu Bhattacharya, 2014-09-24, 10:23
[expand - 2 more] - Re: Spark - Apache Blur Connector : Index Kafka Messages into Blur using Spark Streaming - Blur - [mail # dev]
...Thanks Aaron. I would love to do that.DibyenduOn Sep 23, 2014 5:17 PM, "Aaron McCurry"  wrote: ...
   Author: Dibyendu Bhattacharya, 2014-09-23, 12:00
[expand - 12 more] - Re: Low Level Kafka Consumer for Spark - Spark - [mail # user]
...Hi Tim,I have not tried persist the RDD.Here are some discussion on Rate Limiting Spark Streaming is there in thisthread.http://apache-spark-user-list.1001560.n3.nabble.com/spark-streaming-r...
   Author: Dibyendu Bhattacharya, 2014-09-15, 17:25
[expand - 2 more] - Re: Some Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed.. - Spark - [mail # user]
...I agree,Even the Low Level Kafka Consumer which I have written has tunable IOthrottling which help me solve this issue ... But question remains , evenif there are large backlog, why Spark dr...
   Author: Dibyendu Bhattacharya, 2014-09-12, 12:24
[expand - 1 more] - Re: How to scale more consumer to Kafka stream - Spark - [mail # user]
...I agree Gerard. Thanks for pointing this..DibOn Thu, Sep 11, 2014 at 5:28 PM, Gerard Maas  wrote: ...
   Author: Dibyendu Bhattacharya, 2014-09-11, 13:12
Presenting "Near Real Time Indexing Kafka Messages into Apache Blur" at Lucene Solr Revolution - Blur - [mail # dev]
...Dear All,Here is the session details on "Near Real Time Indexing Kafka Messages intoApache Blur"  which we will be presenting at LuceneSolr Revolution.http://lucenerevolution.org/presen...
   Author: Dibyendu Bhattacharya, 2014-09-01, 05:16
Re: Kafka stream receiver stops input - Spark - [mail # user]
...I think this is a known issue in Existing KafkaUtils. Even we had thisissue. The problem is in Existing KafkaUtil there is no way to control themessage flow.You can refer to another mail thr...
   Author: Dibyendu Bhattacharya, 2014-08-28, 01:39
Re: Data loss - Spark streaming and network receiver - Spark - [mail # user]
...Dear All,Recently I have written a Spark Kafka Consumer to solve this problem. Evenwe have seen issues with KafkaUtils which is using Highlevel Kafka Consumerand consumer code has no handle ...
   Author: Dibyendu Bhattacharya, 2014-08-19, 04:32
Re: Spark stream data from kafka topics and output as parquet file on HDFS - Spark - [mail # user]
...You can try this Kafka Spark Consumer which I recently wrote. This uses theLow Level Kafka Consumerhttps://github.com/dibbhatt/kafka-spark-consumerDibyenduOn Tue, Aug 5, 2014 at 12:52 PM, ra...
   Author: Dibyendu Bhattacharya, 2014-08-05, 08:55
Sort:
project
Blur (11)
Spark (7)
Kafka (2)
type
mail # user (12)
mail # dev (6)
issue (2)
date
last 7 days (1)
last 30 days (3)
last 90 days (10)
last 6 months (15)
last 9 months (20)
author
Ted Yu (1699)
Harsh J (1295)
Todd Lipcon (994)
Stack (978)
Jun Rao (969)
Jonathan Ellis (844)
Andrew Purtell (815)
Jean-Daniel Cryans (753)
Yusaku Sako (718)
stack (714)
Jarek Jarcec Cecho (703)
Eric Newton (688)
Jonathan Hsieh (673)
Roman Shaposhnik (663)
Namit Jain (649)
Hitesh Shah (627)
Owen O'Malley (625)
Steve Loughran (624)
Siddharth Seth (614)
Josh Elser (556)
Brock Noland (549)
Eli Collins (545)
Neha Narkhede (545)
Arun C Murthy (543)
Doug Cutting (533)
Dibyendu Bhattacharya