Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 19 (0.227s).
Loading phrases to help you
refine your search...
Spark summit 2014 videos ? - Spark - [mail # user]
...Hi,I did not find any videos on apache spark channel in youtube yet.Any idea when these will be made available ?Regards,Ajay ...
   Author: Ajay Srivastava, 2014-07-11, 05:13
[expand - 1 more] - Re: OFF_HEAP storage level - Spark - [mail # user]
...Thanks Jerry.It looks like a good option, will try it.Regards,AjayOn Friday, July 4, 2014 2:18 PM, "Shao, Saisai"  wrote: Hi Ajay, StorageLevel OFF_HEAP means for can cache your RD...
   Author: Ajay Srivastava, 2014-07-04, 09:16
[expand - 2 more] - Re: Join : Giving incorrect result - Spark - [mail # user]
...Thanks Matei. We have tested the fix and it's working perfectly.Andrew, we set spark.shuffle.spill=false but the application goes out of memory. I think that is expected.Regards,Ajay On Frid...
   Author: Ajay Srivastava, 2014-06-06, 12:58
[expand - 2 more] - Re: Only log.index - MapReduce - [mail # user]
...Yes. That explains it and confirms my guess too :-)  stderr:156 0 syslog:995 166247  What are these numbers ? Byte offset in corresponding files from where logs of this task starts...
   Author: Ajay Srivastava, 2013-07-24, 06:52
[expand - 1 more] - Re: Unexpected problem in creating temporary file - MapReduce - [mail # user]
...Any suggestion ? I am stuck.   Regards, Ajay Srivastava   On 19-Jul-2013, at 5:54 PM, Ajay Srivastava wrote:  ...
   Author: Ajay Srivastava, 2013-07-20, 01:20
[expand - 2 more] - Re: Cartesian product in hadoop - MapReduce - [mail # user]
...The approach which I proposed will have m+n i/o for reading datasets not the (m + n + m*n) and but further i/o due to spills and reading mapper output by reducer will be more as number of tu...
   Author: Ajay Srivastava, 2013-04-18, 15:18
Re: How to balance reduce job - HDFS - [mail # user]
...Tariq probably meant distribution of keys from  pair emitted by mapper. Partitioner distributes these pairs to different reducers based on key. If data is such that keys are skewed then...
   Author: Ajay Srivastava, 2013-04-17, 06:02
Re: How to shuffle (Key,Value) pair from mapper to multiple reducer - HDFS - [mail # user]
...Emit (key, value) twice from mapper by modifying key as key' = (key, partId) and record becomes (key', value)   Regards, Ajay Srivastava   On 13-Mar-2013, at 2:29 PM, Vikas Jadhav ...
   Author: Ajay Srivastava, 2013-03-13, 09:10
Re: Need help optimizing reducer - MapReduce - [mail # user]
...Are you using combiner ? If not, that will be first thing to do.   On 05-Mar-2013, at 1:27 AM, Austin Chungath wrote:  ...
   Author: Ajay Srivastava, 2013-03-05, 06:30
Spilled records - MapReduce - [mail # user]
...Hi,  I was tuning mapred job to reduce number of spills and reached a stage where following numbers are same -  Spilled Records in map = Spilled records in reduce = Combine output ...
   Author: Ajay Srivastava, 2013-01-23, 10:34
Sort:
project
Hadoop (7)
MapReduce (5)
HDFS (4)
Spark (3)
type
mail # user (19)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (3)
last 9 months (19)
author
Ted Yu (1706)
Harsh J (1297)
Jun Rao (1057)
Todd Lipcon (995)
Stack (978)
Jonathan Ellis (844)
Andrew Purtell (822)
Jean-Daniel Cryans (752)
Yusaku Sako (735)
stack (723)
Jarek Jarcec Cecho (704)
Eric Newton (697)
Jonathan Hsieh (674)
Neha Narkhede (673)
Roman Shaposhnik (666)
Namit Jain (649)
Hitesh Shah (626)
Steve Loughran (626)
Owen O'Malley (625)
Siddharth Seth (615)
Josh Elser (598)
Brock Noland (563)
Eli Collins (545)
Arun C Murthy (543)
Doug Cutting (536)
Ajay Srivastava