Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 39 (0.206s).
Loading phrases to help you
refine your search...
Re: Shuffle files - Spark - [mail # user]
...My observation is opposite. When my job runs under defaultspark.shuffle.manager, I don't see this exception. However, when it runswith SORT based, I start seeing this error? How would that b...
   Author: Chen Song, 2014-10-21, 01:10
[expand - 2 more] - Re: Does SparkSQL work with custom defined SerDe? - Spark - [mail # user]
...Looks like it may be related tohttps://issues.apache.org/jira/browse/SPARK-3807.I will build from branch 1.1 to see if the issue is resolved.ChenOn Tue, Oct 14, 2014 at 10:33 AM, Chen Song &...
   Author: Chen Song, 2014-10-14, 22:33
[expand - 1 more] - Re: mapreduce.job.queuename doesn't work with hiveserver2 - Hive - [mail # user]
...Thanks for the reply. I am using Hue so I may need to find a way to hackthis into Hue.On Fri, Oct 10, 2014 at 7:39 AM, Navdeep Agrawal <[EMAIL PROTECTED]> wrote:Chen Song ...
   Author: Chen Song, 2014-10-10, 18:51
Re: Spark SQL and Hive tables - Spark - [mail # user]
...I have ran into the same issue. I understand with the new assembly builtwith -Phive, I can run a spark job in yarn-cluster mode. But is there a wayfor me to run spark-shell with support of h...
   Author: Chen Song, 2014-09-30, 15:56
[expand - 1 more] - Re: spark time out - Spark - [mail # user]
...I am running the job on 500 executors, each with 8G and 1 core.See lots of fetch failures on reduce stage, when running a simplereduceByKeymap tasks -> 4000reduce tasks -> 200On Mon, S...
   Author: Chen Song, 2014-09-23, 18:14
[expand - 1 more] - Re: exception in spark 1.1.0 - Spark - [mail # user]
...snappy native lib was installed as part of hadoop (cdh5.1.0)the location is in /usr/lib/hadoop/lib/-rwxr-xr-x 1 hdfs hadoop  23904 Jul 12 14:11 libsnappy.so.1.1.3lrwxrwxrwx 1 hdfs hadoo...
   Author: Chen Song, 2014-09-22, 13:31
spark job hung up - Spark - [mail # user]
...I am testing my spark job on yarnspark: 1.0.0-cdh5.1.0yarn: cdh5.1.0Once a while the spark job hung up (stuck in some stage without anyprogress on driver and executors) after some failures. ...
   Author: Chen Song, 2014-09-20, 09:08
[expand - 2 more] - Re: hive auto join conversion - Hive - [mail # user]
...Yeah, I was trying the same thing, though a little big ugly.My query needs to LJ/J with multiple tables. When there are 1 or 2 LJ/Js,rewriting works but when there are > 3 tables, the got...
   Author: Chen Song, 2014-08-12, 15:38
[expand - 4 more] - Re: saveAsTextFiles file not found exception - Spark - [mail # user]
...Thanks for putting this together, Andrew.On Tue, Aug 12, 2014 at 2:11 AM, Andrew Ash  wrote:Chen Song ...
   Author: Chen Song, 2014-08-12, 15:26
[expand - 1 more] - Re: increase parallelism of reading from hdfs - Spark - [mail # user]
...Thanks Paul. I will give a try.On Mon, Aug 11, 2014 at 1:11 PM, Paul Hamilton wrote:Chen Song ...
   Author: Chen Song, 2014-08-11, 19:55
Sort:
project
Spark (16)
Hive (15)
HBase (3)
Hadoop (2)
Flume (1)
Kafka (1)
MapReduce (1)
type
mail # user (39)
date
last 7 days (2)
last 30 days (6)
last 90 days (12)
last 6 months (24)
last 9 months (39)
author
Ted Yu (1695)
Harsh J (1295)
Jun Rao (1060)
Todd Lipcon (1001)
Stack (977)
Jonathan Ellis (844)
Andrew Purtell (824)
Jean-Daniel Cryans (753)
jacques@... (738)
Yusaku Sako (732)
stack (717)
Jarek Jarcec Cecho (703)
Eric Newton (698)
Jonathan Hsieh (675)
Brock Noland (666)
Roman Shaposhnik (665)
Neha Narkhede (663)
Namit Jain (649)
Hitesh Shah (625)
Owen O'Malley (625)
Steve Loughran (622)
Siddharth Seth (614)
Josh Elser (591)
Eli Collins (545)
Arun C Murthy (543)
Chen Song