Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 60 (0.236s).
Loading phrases to help you
refine your search...
[expand - 2 more] - Re: How to change MAX_FILES_PER_REGION_PER_FAMILY in LoadIncrementalHFiles? - HBase - [mail # user]
...Hi Matteo,Thank you for addressing the issue. For now, I will just set the variablein hbase-site.xml.Best Regards,JerryOn Wed, Aug 20, 2014 at 12:33 PM, Matteo Bertozzi wrote: ...
   Author: Jerry Lam, 2014-08-20, 17:24
[expand - 1 more] - Re: Spark SQL and Hive tables - Spark - [mail # user]
...Hi Sameer,The blog post you referred to is about Spark SQL. I don't think the intentof the article is meant to guide you how to read data from Hive via SparkSQL. So don't worry too much abou...
   Author: Jerry Lam, 2014-07-25, 21:48
[expand - 2 more] - Re: Repeated data item search with Spark SQL(1.0.1) - Spark - [mail # user]
...Hi Michael,Thank you for the explanation. Can you validate the following statement istrue/incomplete/false:"hql uses Hive to parse and to construct the logical plan whereas sql ispure spark ...
   Author: Jerry Lam, 2014-07-16, 18:14
[expand - 2 more] - Re: Need help on spark Hbase - Spark - [mail # user]
...Hi Rajesh,I saw : Warning: Local jar /home/rajesh/hbase-0.96.1.1-hadoop2/lib/hbase-client-0.96.1.1-hadoop2.jar, does not exist, skipping.in your log.I believe this jar contains the HBaseConf...
   Author: Jerry Lam, 2014-07-16, 17:56
[expand - 3 more] - Re: How to kill running spark yarn application - Spark - [mail # user]
...For your information, the SparkSubmit runs at the host you executed thespark-submit shell script (which in turns invoke the SparkSubmit program).Since you are running in yarn-cluster mode, t...
   Author: Jerry Lam, 2014-07-15, 14:56
[SPARK-2448] Table name is not getting applied to their attributes after "registerAsTable" - Spark - [issue]
...The following sample code will fail:val hiveContext = new org.apache.spark.sql.hive.HiveContext(sc)import hiveContext._hql("USE test")hql("select id from m").registerAsTable("m")hql("select ...
http://issues.apache.org/jira/browse/SPARK-2448    Author: Jerry Lam, 2014-07-14, 20:57
Re: Can we get a spark context inside a mapper - Spark - [mail # user]
...Hi there,I think the question is interesting; a spark of sparks = sparkI wonder if you can use the spark job server (https://github.com/ooyala/spark-jobserver)?So in the spark task that requ...
   Author: Jerry Lam, 2014-07-14, 19:21
[expand - 1 more] - Re: Potential bugs in SparkSQL - Spark - [mail # user]
...Hi Michael,I got the log you asked for. Note that I manually edited the table name andthe field names to hide some sensitive information.== Logical Plan ==Project ['s.id] Join Inner, So...
   Author: Jerry Lam, 2014-07-11, 00:46
[expand - 3 more] - Re: Using HQL is terribly slow: Potential Performance Issue - Spark - [mail # user]
...Hi Michael,Yes the table is partitioned on 1 column. There are 11 columns in the tableand they are all String type.I understand that SerDes contributes to some overheads but using pure Hive,...
   Author: Jerry Lam, 2014-07-11, 00:34
[expand - 1 more] - Re: Purpose of spark-submit? - Spark - [mail # user]
...Sandy, I experienced the similar behavior as Koert just mentioned. I don'tunderstand why there is a difference between using spark-submit andprogrammatic execution. Maybe there is something ...
   Author: Jerry Lam, 2014-07-09, 16:26
Sort:
project
HBase (35)
Pig (11)
Spark (11)
MapReduce (3)
type
mail # user (58)
issue (2)
date
last 7 days (0)
last 30 days (0)
last 90 days (1)
last 6 months (14)
last 9 months (60)
author
Ted Yu (1698)
Harsh J (1294)
Todd Lipcon (995)
Stack (978)
Jun Rao (970)
Jonathan Ellis (844)
Andrew Purtell (816)
Jean-Daniel Cryans (753)
Yusaku Sako (720)
stack (714)
Jarek Jarcec Cecho (703)
Eric Newton (688)
Jonathan Hsieh (673)
Roman Shaposhnik (662)
Namit Jain (649)
Hitesh Shah (627)
Owen O'Malley (625)
Steve Loughran (624)
Siddharth Seth (614)
Josh Elser (561)
Brock Noland (549)
Neha Narkhede (546)
Eli Collins (545)
Arun C Murthy (543)
Doug Cutting (536)
Jerry Lam