| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
20 (0.216s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Mutiple dfs.data.dir vs RAID0 - MapReduce - [mail # user]
|
|
...Interesting question. You'd probably need to benchmark to prove it out. I'm not the exact details of how HDFS stripes data, but it should compare pretty well to hardware RAID. &n...
|
|
|
Author: Chris Embree,
2013-02-11, 02:22
|
|
|
Re: Interested in learning hadoop - MapReduce - [mail # user]
|
|
...Just to maintain some balance on the list, Hortonworks has similar training vidos and a sandbox appliance. http://hortonworks.com/community/ Enjoy. On Sat, Feb 2, 2013 at 1...
|
|
|
Author: Chris Embree,
2013-02-02, 15:53
|
|
|
Where do/should .jar files live? - MapReduce - [mail # user]
|
|
...Hi List, This should be a simple question, I think. Disclosure, I am not a java developer. ;) We're getting ready to build our Dev and Prod clusters. I'm pretty comfortable...
|
|
|
Author: Chris Embree,
2013-01-22, 19:24
|
|
|
Re: modifying existing wordcount example - MapReduce - [mail # user]
|
|
...Can you instead copy intput1 and input2 together? Or process both files on the second pass? Otherwise, you'll have to read in output file, load the values and start your map/red ...
|
|
|
Author: Chris Embree,
2013-01-17, 02:13
|
|
|
Re: Hadoop NON DFS space - MapReduce - [mail # user]
|
|
...Ha, you joke, but we're planning on running with no local OS. If it works as planned I'll post a nice summary of our approach. :) On Wed, Jan 16, 2013 at 2:53 AM, Harsh J w...
|
|
|
Author: Chris Embree,
2013-01-16, 12:45
|
|
|
Re: datanode write forwarding - MapReduce - [mail # user]
|
|
...Harsh, Is that a change from 1.0 code? Hortonworks explains it a little differently. Thanks for the details and pointer to the code. Chris (another one) On Dec 18, 20...
|
|
|
Author: Chris Embree,
2012-12-18, 22:19
|
|
|
Re: datanode write forwarding - MapReduce - [mail # user]
|
|
...Hi Jay, We'll need "real developer" expertise on this, but my understanding of the documentation is: Client talks to Name node to get Node/Block assignments, client then ta...
|
|
|
Author: Chris Embree,
2012-12-18, 21:09
|
|
|
Re: number of mapred slots - MapReduce - [mail # user]
|
|
...I think the rule of thumb (hortonworks at least) is 2x cores for maps threads and 1x cores for reducers. Don't have my notes here so I'm not 100%. It's just a guideline in any ev...
|
|
|
Author: Chris Embree,
2012-12-18, 06:12
|
|
|
Re: Hadoop 101 - MapReduce - [mail # user]
|
|
...Just to be a picker of nits... this topic is more concisely Hadoop Development 101. I only mention this because I am a newbie hadoop admin and this was over my head. ;) Admins do...
|
|
|
Author: Chris Embree,
2012-12-13, 05:11
|
|
|
Re: Sane max storage size for DN - MapReduce - [mail # user]
|
|
...Hi Mohammed, The amount of RAM on the NN is related to the number of blocks... so let's do some math. :) 1G of RAM to 1M blocks seems to be the general rule. I'll probably ...
|
|
|
Author: Chris Embree,
2012-12-13, 05:08
|
|
|
|
