Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 41 (0.208s).
Loading phrases to help you
refine your search...
Re: "Fetch Failure" - Spark - [mail # user]
...I tried both 1.1.1 and 1.2.0 (built against cdh5.1.0 and hadoop2.3) but Iam still seeing FetchFailedException.On Mon, Dec 22, 2014 at 8:27 AM, steghe  wrote:Chen Song ...
   Author: Chen Song, 2014-12-23, 20:11
serialize protobuf messages - Spark - [mail # user]
...Silly question, what is the best way to shuffle protobuf messages in Spark(Streaming) job? Can I use Kryo on top of protobuf Message type?Chen Song ...
   Author: Chen Song, 2014-12-23, 20:10
[expand - 1 more] - Re: question on HIVE-5891 - Hive - [mail # user]
...I haven't found a workaround yet.On Thu, Nov 13, 2014 at 11:25 AM, St├ęphane Verlet <[EMAIL PROTECTED]Chen Song ...
   Author: Chen Song, 2014-11-18, 18:49
Re: Shuffle files - Spark - [mail # user]
...My observation is opposite. When my job runs under defaultspark.shuffle.manager, I don't see this exception. However, when it runswith SORT based, I start seeing this error? How would that b...
   Author: Chen Song, 2014-10-21, 01:10
[expand - 2 more] - Re: Does SparkSQL work with custom defined SerDe? - Spark - [mail # user]
...Looks like it may be related tohttps://issues.apache.org/jira/browse/SPARK-3807.I will build from branch 1.1 to see if the issue is resolved.ChenOn Tue, Oct 14, 2014 at 10:33 AM, Chen Song &...
   Author: Chen Song, 2014-10-14, 22:33
[expand - 1 more] - Re: mapreduce.job.queuename doesn't work with hiveserver2 - Hive - [mail # user]
...Thanks for the reply. I am using Hue so I may need to find a way to hackthis into Hue.On Fri, Oct 10, 2014 at 7:39 AM, Navdeep Agrawal <[EMAIL PROTECTED]> wrote:Chen Song ...
   Author: Chen Song, 2014-10-10, 18:51
Re: Spark SQL and Hive tables - Spark - [mail # user]
...I have ran into the same issue. I understand with the new assembly builtwith -Phive, I can run a spark job in yarn-cluster mode. But is there a wayfor me to run spark-shell with support of h...
   Author: Chen Song, 2014-09-30, 15:56
[expand - 1 more] - Re: spark time out - Spark - [mail # user]
...I am running the job on 500 executors, each with 8G and 1 core.See lots of fetch failures on reduce stage, when running a simplereduceByKeymap tasks -> 4000reduce tasks -> 200On Mon, S...
   Author: Chen Song, 2014-09-23, 18:14
[expand - 1 more] - Re: exception in spark 1.1.0 - Spark - [mail # user]
...snappy native lib was installed as part of hadoop (cdh5.1.0)the location is in /usr/lib/hadoop/lib/-rwxr-xr-x 1 hdfs hadoop  23904 Jul 12 14:11 libsnappy.so.1.1.3lrwxrwxrwx 1 hdfs hadoo...
   Author: Chen Song, 2014-09-22, 13:31
spark job hung up - Spark - [mail # user]
...I am testing my spark job on yarnspark: 1.0.0-cdh5.1.0yarn: cdh5.1.0Once a while the spark job hung up (stuck in some stage without anyprogress on driver and executors) after some failures. ...
   Author: Chen Song, 2014-09-20, 09:08
Sort:
project
Spark (18)
Hive (15)
HBase (3)
Hadoop (2)
Flume (1)
Kafka (1)
MapReduce (1)
type
mail # user (41)
date
last 7 days (2)
last 30 days (2)
last 90 days (7)
last 6 months (21)
last 9 months (41)
author
Ted Yu (1843)
Harsh J (1303)
Jun Rao (1016)
Todd Lipcon (997)
Stack (985)
Andrew Purtell (882)
Jonathan Ellis (854)
stack (765)
Jean-Daniel Cryans (752)
Jarek Jarcec Cecho (747)
Yusaku Sako (745)
Eric Newton (707)
Jonathan Hsieh (685)
Hitesh Shah (684)
Roman Shaposhnik (679)
Josh Elser (678)
Steve Loughran (651)
Namit Jain (648)
Siddharth Seth (644)
Brock Noland (635)
Owen O'Malley (623)
Hyunsik Choi (584)
Neha Narkhede (568)
Arun C Murthy (548)
Eli Collins (545)
Chen Song
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB