| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
213 (0.191s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Chaining MapReduce Jobs - Hadoop - [mail # general]
|
|
...Have you looked at the ToolRunner class? On Nov 8, 2012, at 7:03 AM, Claudio Reggiani wrote: ...
|
|
|
Author: Michael Segel,
2012-11-08, 19:12
|
|
|
Re: Disks RAID best practice - Hadoop - [mail # user]
|
|
...Oleg, that's for an overall raid preference. Specifically for the 'control nodes' aka (NN, SN, JT, HM, ZK...) I tend to just use simple mirroring because these processes are no...
|
|
|
Author: Michael Segel,
2012-11-01, 14:49
|
|
|
Re: Disks RAID best practice - Hadoop - [mail # user]
|
|
...I prefer RAID 10, but some say RAID 6. I thought NetApp used RAID 6 ? Its definitely an interesting discussion point though. -Mike On Nov 1, 2012, at 7:37 AM, Oleg...
|
|
|
Author: Michael Segel,
2012-11-01, 12:43
|
|
|
Re: measuring iops - Hadoop - [mail # user]
|
|
...You have two issues. 1) You need to know the throughput in terms of data transfer between disks and controller cards on the node. 2) The actual network throughput of havin...
|
|
|
Author: Michael Segel,
2012-10-23, 13:19
|
|
|
Re: Hadoop counter - Hadoop - [mail # user]
|
|
...Yup. The counters at the end of the job are the most accurate. On Oct 22, 2012, at 3:00 AM, Lin Ma wrote: discussion. how/when JT merge counter in the middle of the ...
|
|
|
Author: Michael Segel,
2012-10-23, 03:57
|
|
|
Re: reg hadoop on AWS - Hadoop - [mail # user]
|
|
...Actually the best way to do it is to use EMR since everything is then built for you. On Oct 5, 2012, at 7:21 AM, Nitin Pawar wrote: problem with the parameters...
|
|
|
Author: Michael Segel,
2012-10-05, 12:57
|
|
|
Re: Which hardware to choose - Hadoop - [mail # user]
|
|
...Well... If you're not running HBase, you're less harmed by minimal swapping so you could push the number of slots and over subscribe. The only thing I would have to sugges...
|
|
|
Author: Michael Segel,
2012-10-03, 17:21
|
|
|
Re: Which hardware to choose - Hadoop - [mail # user]
|
|
...Ah that's the $64,000.00 (USD) question.... I tend to be conservative so this should be a good starting point. You start with 2 things... the amount of memory available and the...
|
|
|
Author: Michael Segel,
2012-10-03, 02:35
|
|
|
Re: Which hardware to choose - Hadoop - [mail # user]
|
|
...I think he's saying that its 24 maps 8 reducers per node and at 48GB that could be too many mappers. Especially if they want to run HBase. On Oct 2, 2012, at 8:14 PM, hado...
|
|
|
Author: Michael Segel,
2012-10-03, 01:40
|
|
|
Re: HADOOP in Production - Hadoop - [mail # user]
|
|
...Funny that the OP asks about 'real time'... This comes up quiet often and its always misunderstood. First, when we say 'real time' many take it to mean subjective real tim...
|
|
|
Author: Michael Segel,
2012-10-02, 12:04
|
|
|
|
