Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Re: queries and MR jobs


Copy link to this message
-
Re: queries and MR jobs
Currently there is no way of doing what you requested.

If you're concerned with locality, HBASE-4755 'HBase based block placement
in DFS' may be of interest to you.

Cheers

On Fri, Feb 15, 2013 at 12:37 PM, Pamecha, Abhishek <[EMAIL PROTECTED]>wrote:

> Hi
>
> Is there a way to partition HDFS [replication factor, say 3]] or route
> requests to specific RS nodes so that
>
> One set of nodes serve operations like put and get etc.
> Other set of nodes do MR on the same replicated  data set
> And those two sets don't share the same nodes?
>
> I mean, If we are replicating and not worried about consistency equally
> across all replicas, can we allocate different jobs to different replicas
> based on that replica's consistency tuning.
>
> I understand that HDFS interleaves replicated data across nodes so we
> don't have cookie-cut isolated replicas. And thus this question becomes
> more interesting? :)
>
> An underlying question is how a node of its 2 other replicas, gets chosen
> for a specific request[ put/get] or a MR job.
>
> Thanks,
> Abhishek
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB