Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 56 (0.292s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: Using CUDA within Spark / boosting linear algebra - Spark - [mail # dev]
...Sam,whould it be easier to hack netlib-java to allow multiple (configurable) library contexts? And so enable 3rd party configurations and optimizers tomake their own choices until then?...
   Author: Dmitriy Lyubimov, 2015-03-25, 22:17
Re: Hanging tasks in spark 1.2.1 while working with 1.1.1 - Spark - [mail # user]
...FWIW observed similar behavior in similar situation. Was able to workaround by forcefully committing one of the rdds right before the unioninto cache, and forcing that by executing take(1). ...
   Author: Dmitriy Lyubimov, 2015-03-18, 00:26
[SPARK-869] Retrofit rest of RDD api to use proper serializer type - Spark - [issue]
...SPARK-826 and SPARK-827 resolved proper serialization support for some RDD method parameters, but  not all. This issue is to address the rest of RDD api and operations. Most of the time...
http://issues.apache.org/jira/browse/SPARK-869    Author: Dmitriy Lyubimov, 2015-02-28, 03:51
Re: renaming SchemaRDD -> DataFrame - Spark - [mail # dev]
...It has been pretty evident for some time that's what it is, hasn't it?Yes that's a better name IMO.On Mon, Jan 26, 2015 at 2:18 PM, Reynold Xin  wrote: ...
   Author: Dmitriy Lyubimov, 2015-01-27, 20:07
Task result deserialization error (1.1.0) - Spark - [mail # user]
...Hi,I am getting task result deserialization error (kryo is enabled). Is itsome sort of `chill` registration issue at front end?This is application that lists spark as maven dependency (so it...
   Author: Dmitriy Lyubimov, 2015-01-21, 02:37
[SPARK-835] RDD$parallelize() should use object serializer (not closure serializer) for collection objects - Spark - [issue]
...This is a twin issue for SPARK-826 encapsulating all use cases where collection of objects is transferred from front end to backend RDDs....
http://issues.apache.org/jira/browse/SPARK-835    Author: Dmitriy Lyubimov, 2014-11-14, 09:55
Re: Upgrade to Spark 1.1.0? - Spark - [mail # user]
...Mahout context does not include _all_ possible transitive dependencies.Would not be lighting fast to take all legacy etc. dependencies.There's an "ignored" unit test that asserts context pat...
   Author: Dmitriy Lyubimov, 2014-10-20, 04:03
[expand - 2 more] - Re: Spark QL and protobuf schema - Spark - [mail # user]
...Ok, I was just asking that the changes you've mentioned are likely to befound on 1.1 branch so it would make sense for my starting point to forkoff 1.1. Or perhaps master.The question of PR ...
   Author: Dmitriy Lyubimov, 2014-08-25, 19:50
[expand - 1 more] - Re: Unit test best practice for Spark-derived projects - Spark - [mail # dev]
...Thanks.let me check this hypothesis (i have dhcp connection on a private net butconsequently not sure if there's an inverse).On Thu, Aug 7, 2014 at 10:29 AM, Madhu  wrote: ...
   Author: Dmitriy Lyubimov, 2014-08-07, 17:46
"log" overloaded in SparkContext/ Spark 1.0.x - Spark - [mail # dev]
...it would seem the code likeimport o.a.spark.SparkContext._import math._....a = log(b)does not seem to compile anymore with Spark 1.0.x since SparkContext._ alsoexposes a `log` function. Whic...
   Author: Dmitriy Lyubimov, 2014-08-05, 00:02
Sort:
project
HBase (21)
Spark (17)
Pig (9)
MapReduce (6)
HDFS (2)
Zookeeper (1)
type
mail # user (45)
mail # dev (7)
issue (4)
date
last 7 days (0)
last 30 days (1)
last 90 days (5)
last 6 months (7)
last 9 months (56)
author
Ted Yu (2011)
Harsh J (1316)
Jun Rao (1099)
Todd Lipcon (1013)
Stack (1001)
Andrew Purtell (994)
GitHub Import (895)
Jonathan Ellis (861)
Josh Elser (852)
stack (825)
Jarek Jarcec Cecho (814)
Yusaku Sako (790)
Hitesh Shah (781)
Siddharth Seth (761)
Jean-Daniel Cryans (752)
Eric Newton (734)
Brock Noland (724)
Steve Loughran (711)
Jonathan Hsieh (701)
Roman Shaposhnik (688)
James Taylor (677)
Namit Jain (648)
Hyunsik Choi (646)
Owen O'Malley (619)
Bikas Saha (582)
Dmitriy Lyubimov
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB