Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> best way to join?


Copy link to this message
-
Re: best way to join?
On Sun, Sep 2, 2012 at 12:26 PM, dexter morgan <[EMAIL PROTECTED]>wrote:

> ... Either way, any clustering process requires calculating the distance
> of all points (not between all the points, but of all of them to some
> relative point). Because i'll need a clustering MR job, ill probably use
> it, despite as you said, it has high probability to be correct (not 100%)...
>

This is probably right as stated, but I think that there is confusion here.

Many people assume that each point in the training data has to have
distance computed to all centroids in the clustering.  Even this is not
true.

It is true that you have to compute distance to at least one something, but
not necessarily to all of the clusters.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB