-Re: HRegionPartitioner breaks my configuration
Harsh J 2012-05-09, 17:17
Could you share your whole stack trace?
How do you launch your HBase+MR job? The ideal way is to simply do:
HADOOP_CLASSPATH=`hbase classpath` hadoop jar <hbase job jar> <args>
And this will take care of hbase-site.xml location appearing in the
classpath as well. If you're using a package-installed environment,
ensure /etc/hbase/conf/hbase-site.xml is populated with the right
settings and if not, make such a file and:
Before running the former command.
Let us know if this helps.
On Wed, May 9, 2012 at 9:38 PM, Christoph Bauer
<[EMAIL PROTECTED]> wrote:
> first, I'm aware of HBASE-4398 though I don't know how that patch could work.
> I'm on a cdh3u3 cluster with 4 nodes. hbase is 0.90.4.
> The problem is zookeeper is running on port 2222
> The following line results in a NPE when the mappers start:
> IdentityTableReducer.class, job, HRegionPartitioner.class);
> HBaseConfiguration.addHbaseResources in HRegionPartitioner.setConf
> overwrites quorum and clientPort with hbase-default.xml from hbase
> jar, maybe more.
> HBaseConfiguration.addHbaseResources also tries to load
> hbase-site.xml, but fails silently (not found as resource).
> Can I make my mapreduce jobs aware of this resource. i.e. pass it to
> all the mappers or do I have to ask my administrator to make some
> Thank you,
> Christoph Bauer