On Fri, Jul 26, 2013 at 9:52 AM, Michael Segel <[EMAIL PROTECTED]>wrote:
> Hoya == HBase on Yarn. > > So I guess this would be appropriate for the Hbase mailing list. > > It sounds interesting, but I wonder if HBase and YARN are a bit orthogonal > to one another? > HBase tends to be static in terms of sizing… > > Thoughts? > > Thx > > -Mike > >
On Mon, Jul 29, 2013 at 10:11 AM, Steve Loughran <[EMAIL PROTECTED]>wrote:
> I'm somewhere on safari in Tanzania right now, so all I have to add is > > http://steveloughran.blogspot.com/2013/06/hoya-hbase-on-yarn.html > > YARN lets you ask for compute/RAM capacity near the nodes you request, so > if/when region servers can be given the regions for the data closest to > them, you will be able to request region server instances near the data. > > 0.1 had to viewed as a throwaway PoC to show it can be done and identify > areas where both YARN and hbase need to be improved. For YARN there's an > uber JIRA. For hbase, apart from the locality of RS on startup, I'd like > the ports/URLs of the web servers of every node published on ZK or > elsewhere, as we have to say port 0 for all service ports, otherwise oh may > clash with existing instances > > ---------- ---------- > From: Michael Segel <[EMAIL PROTECTED]> > Date: Mon, Jul 29, 2013 at 7:30 AM > Subject: Re: Anyone playing/looking at Hoya? > To: [EMAIL PROTECTED] > > > Ted, > > Thanks, but I already read that, which prompted me to ask the question > about Hoya because I am curious about HBase on a YARN cluster. > > To me they seem orthogonal because you want HBase on the HDFS/Compute > nodes for data locality. > > My understanding of YARN is that you dynamically build the cluster around > your M/R job. Or is that an over simplification? > > Thx > > -Mike > > On Jul 27, 2013, at 6:00 PM, Ted Yu <[EMAIL PROTECTED]> wrote: > > > http://hortonworks.com/blog/introducing-hoya-hbase-on-yarn/ > > >
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext