| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
53 (0.381s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: DFS respond very slow - MapReduce - [mail # user]
|
|
...Uhhh... Alexey, did you really mean that you are running 100 mega bit per second network links? That is going to make hadoop run *really* slowly. Also, putting RAID under any DFS...
|
|
|
Author: Ted Dunning,
2012-10-16, 02:23
|
|
|
Re: Suitability of HDFS for live file store - MapReduce - [mail # user]
|
|
...If you are going to mention commercial distros, you should include MapR as well. Hadoop compatible, very scalable and handles very large numbers of files in a Posix-ish environment. &n...
|
|
|
Author: Ted Dunning,
2012-10-15, 22:17
|
|
|
Re: Spindle per Cores - MapReduce - [mail # user]
|
|
...I think that this rule of thumb is to prevent people configuring 2 disk clusters with 16 cores or 48 disk machines with 4 cores. Both configurations could make sense in narrow applicat...
|
|
|
Author: Ted Dunning,
2012-10-12, 20:52
|
|
|
Re: Spindle per Cores - MapReduce - [mail # user]
|
|
...It depends on your distribution. Some distributions are more efficient at driving spindles than others. Ratios as high as 2 spindles per core are sometimes quite reasonable. &nbs...
|
|
|
Author: Ted Dunning,
2012-10-12, 19:11
|
|
|
Re: Logistic regression package on Hadoop - MapReduce - [mail # user]
|
|
...Harsh, THanks for the plug. Rajesh has been talking to us. On Fri, Oct 12, 2012 at 8:36 AM, Harsh J wrote: ...
|
|
|
Author: Ted Dunning,
2012-10-12, 17:21
|
|
|
Re: Hadoop/Lucene + Solr architecture suggestions? - MapReduce - [mail # user]
|
|
...Your mileage will vary. I find that this exact motion is what makes reduce side indexing very attractive since it allows precise sharding control. On Thu, Oct 11, 2012 at 10:20 P...
|
|
|
Author: Ted Dunning,
2012-10-12, 05:23
|
|
|
Re: Why they recommend this (CPU) ? - MapReduce - [mail # user]
|
|
...Like I said, measure twice, cut once. On Thu, Oct 11, 2012 at 12:47 PM, Goldstone, Robin J. wrote: ...
|
|
|
Author: Ted Dunning,
2012-10-11, 19:56
|
|
|
Re: Why they recommend this (CPU) ? - MapReduce - [mail # user]
|
|
...You should measure your workload. Your experience will vary dramatically with different computations. On Thu, Oct 11, 2012 at 10:56 AM, Russell Jurney wrote: ...
|
|
|
Author: Ted Dunning,
2012-10-11, 18:38
|
|
|
Re: Hadoop/Lucene + Solr architecture suggestions? - MapReduce - [mail # user]
|
|
...Having solr cloud do the indexing instead of having map-reduce do the indexing causes substantial write amplification. The issue is that cores are replicated in solr cloud. To ke...
|
|
|
Author: Ted Dunning,
2012-10-11, 06:13
|
|
|
Re: Hadoop/Lucene + Solr architecture suggestions? - MapReduce - [mail # user]
|
|
...I prefer to create indexes in the reducer personally. Also you can avoid the copies if you use an advanced hadoop-derived distro. E mail me off list for details. Sent from my i...
|
|
|
Author: Ted Dunning,
2012-10-10, 14:58
|
|
|
|
