| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
13 (0.102s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Hadoop 1.0.4 Performance Problem - Hadoop - [mail # user]
|
|
...Hi Chris, The standalone log analyzer was released in December and designed to be easier to use. Regarding the license, I think it's ok to use it in the commercial environment fo...
|
|
|
Author: Jie Li,
2012-12-20, 00:27
|
|
|
Re: MAP PHASE,SHUFFLE SORT PHASE AND COPY PHASE , REDUCE PHASE - Hadoop - [mail # user]
|
|
...Is this view what you want? http://www.cs.duke.edu/starfish/screenshots/job-analysis-profile-graphs.png Jie On Fri, Sep 21, 2012 at 3:50 PM, Thiago Vieira wrote:...
|
|
|
Author: Jie Li,
2012-10-14, 22:43
|
|
|
Re: can i specify no shuffle and/or no sort in the reducer and no disk space left IOException when there is DFS space remaining - Hadoop - [mail # user]
|
|
...You don't need to specify the reducer at all. Yeah the map output will go to HDFS directly. It's called map-only job. Jie On Thursday, March 8, 2012, Jane Wayne wrote: &nbs...
|
|
|
Author: Jie Li,
2012-03-08, 05:19
|
|
|
Re: can i specify no shuffle and/or no sort in the reducer and no disk space left IOException when there is DFS space remaining - Hadoop - [mail # user]
|
|
...Hi Jane, The default Reducer (IdentityReducer) would simply read/write everything that goes through it. By default Shuffling would also happen and the map output data is partitioned by...
|
|
|
Author: Jie Li,
2012-03-08, 05:02
|
|
|
Re: Profiling Hadoop Job - Hadoop - [mail # user]
|
|
...Hi Leo, Thanks for pointing out the outdated README file. Glad to tell you that we do support the old API in the latest version. See here: http://www.cs.duke.edu/starfish/p...
|
|
|
Author: Jie Li,
2012-03-07, 20:47
|
|
|
Re: Profiling Hadoop Job - Hadoop - [mail # user]
|
|
...Hi Leonardo, You might want to try Starfish which supports the memory profiling as well as cpu/disk/network profiling for the performance tuning. Jie Starfish is an intelligent p...
|
|
|
Author: Jie Li,
2012-03-07, 20:19
|
|
|
Re: Hadoop pain points? - Hadoop - [mail # user]
|
|
...I found a related question here: http://www.quora.com/Hadoop-Operability/Is-Hadoop-now-easy-to-use-If-not-what-assistance-do-most-users-need Jie On Fri, Mar 2, 2012 at 10:5...
|
|
|
Author: Jie Li,
2012-03-03, 16:16
|
|
|
Re: Spilled Records - Hadoop - [mail # user]
|
|
...Hi Dan, You might want to post your Pig script to the Pig user mailing list. Previously I did some experiments on Pig and Hive and I'll also be interested in looking into your script. ...
|
|
|
Author: Jie Li,
2012-02-28, 17:31
|
|
|
Re: Spilled Records - Hadoop - [mail # user]
|
|
...Hello Dan, The fact that the spilled records are double as the output records means the map task produces more than one spill file, and these spill files are read, merged and written t...
|
|
|
Author: Jie Li,
2012-02-28, 16:34
|
|
|
Re: How to estimate hadoop? - Hadoop - [mail # user]
|
|
...Hi Jinyan, I'd like to introduce you our system Starfish, which can be used to analyze and estimate the Hadoop performance and memory usage. With Starfish, you can analyze the pe...
|
|
|
Author: Jie Li,
2012-02-25, 15:44
|
|
|
|
