Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 6 from 6 (0.177s).
Loading phrases to help you
refine your search...
Re: Data locality across jobs - Spark - [mail # user]
...You can read same partition from every hour's output, union these RDDs and then repartition them as a single partition. This will be done for all partitions one by one. It may not necessaril...
   Author: Ajay Srivastava, 2015-04-03, 10:04
[expand - 2 more] - Re: Some tasks are taking long time - Spark - [mail # user]
...Thanks Nicos.GC does not contribute much to the execution time of the task. I will debug it further today.Regards,Ajay      On Thursday, January 15, 2015 11:55 PM, Nicos ...
   Author: Ajay Srivastava, 2015-01-16, 04:45
[expand - 1 more] - Re: Creating RDD from only few columns of a Parquet file - Spark - [mail # user]
...Setting spark.sql.hive.convertMetastoreParquet to true has fixed this.Regards,Ajay      On Tuesday, January 13, 2015 11:50 AM, Ajay Srivastava  wrote:    H...
   Author: Ajay Srivastava, 2015-01-13, 08:53
Spark summit 2014 videos ? - Spark - [mail # user]
...Hi,I did not find any videos on apache spark channel in youtube yet.Any idea when these will be made available ?Regards,Ajay ...
   Author: Ajay Srivastava, 2014-07-11, 05:13
[expand - 1 more] - Re: OFF_HEAP storage level - Spark - [mail # user]
...Thanks Jerry.It looks like a good option, will try it.Regards,AjayOn Friday, July 4, 2014 2:18 PM, "Shao, Saisai"  wrote: Hi Ajay, StorageLevel OFF_HEAP means for can cache your RD...
   Author: Ajay Srivastava, 2014-07-04, 09:16
[expand - 2 more] - Re: Join : Giving incorrect result - Spark - [mail # user]
...Thanks Matei. We have tested the fix and it's working perfectly.Andrew, we set spark.shuffle.spill=false but the application goes out of memory. I think that is expected.Regards,Ajay On Frid...
   Author: Ajay Srivastava, 2014-06-06, 12:58
Sort:
project
Spark (6)
type
mail # user (6)
date
last 7 days (0)
last 30 days (0)
last 90 days (1)
last 6 months (3)
last 9 months (6)
author
Ted Yu (1387)
GitHub Import (895)
Jun Rao (891)
Jonathan Ellis (872)
Josh Elser (843)
Siddharth Seth (812)
Hitesh Shah (802)
stack (801)
Yusaku Sako (794)
Andrew Purtell (757)
Todd Lipcon (746)
James Taylor (675)
Hyunsik Choi (659)
Jonathan Hsieh (643)
Eric Newton (632)
Namit Jain (615)
Jarek Jarcec Cecho (595)
Roman Shaposhnik (588)
Bikas Saha (586)
Brock Noland (573)
Jaimin D Jetly (555)
Andrew Onischuk (550)
Xiangrui Meng (532)
Andrii Tkach (500)
Srimanth Gunturi (499)
Ajay Srivastava
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB