I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't have
hbase specific jars. By googling I found some articles about only setting
base but none of them talks about setting up hadoop and hbase with eclipse.

-jignesh

Jignesh,

AFAIK, there isn't a HBase eclipse plugin integration available yet, to browse tables and such (was that your intention?).

I don't think Karmasphere integration tools have HBase in it yet, but there is work ongoing I guess, from [0].

The only visual browser for HBase I've seen and used so far is Lars George's https://github.com/larsgeorge/hbase-explorer, which is a HUE application [1].

I'm interested in hearing about others if they've popped up somewhere.

Otherwise, you need to make do with HBase's web UI, and the shell.

[0] - http://old.nabble.com/karmasphere-hbase-td27316495.html
[1] - http://cloudera.github.com/hue/

On 18-Oct-2011, at 11:32 PM, Jignesh Patel wrote:

> I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't have
> hbase specific jars. By googling I found some articles about only setting
> base but none of them talks about setting up hadoop and hbase with eclipse.
>
> -jignesh

Not sure what kind of integration you're talking about, but if just want to create a project with the HBase source then just grab an SVN checkout of an HBase repo and just do:

mvn eclipse:eclipse

This creates all the necessary project files.  Then just add new project from existing source.

That's the extent to which there exists any HBase integration with eclipse that I know of.

> -----Original Message-----
> From: Jignesh Patel [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, October 18, 2011 11:02 AM
> To: [EMAIL PROTECTED]
> Subject: integrating hadoop and Hbase with eclipse
>
> I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't have
> hbase specific jars. By googling I found some articles about only setting base
> but none of them talks about setting up hadoop and hbase with eclipse.
>
> -jignesh

In addition to what Jonathan just said, see

http://hbase.apache.org/book.html#ides

On 10/19/11 3:05 AM, "Jonathan Gray" <[EMAIL PROTECTED]> wrote:

>Not sure what kind of integration you're talking about, but if just want
>to create a project with the HBase source then just grab an SVN checkout
>of an HBase repo and just do:
>
>mvn eclipse:eclipse
>
>This creates all the necessary project files.  Then just add new project
>from existing source.
>
>That's the extent to which there exists any HBase integration with
>eclipse that I know of.
>
>> -----Original Message-----
>> From: Jignesh Patel [mailto:[EMAIL PROTECTED]]
>> Sent: Tuesday, October 18, 2011 11:02 AM
>> To: [EMAIL PROTECTED]
>> Subject: integrating hadoop and Hbase with eclipse
>>
>> I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't
>>have
>> hbase specific jars. By googling I found some articles about only
>>setting base
>> but none of them talks about setting up hadoop and hbase with eclipse.
>>
>> -jignesh

Dough and Jonathan,
Yes I did follow the steps and with the help of Maven, I have  created
target folder.
But that folder doesn't have anything like eclipse plugin. Something readily
available in hadoop/contrib folder.

What I am looking at this time, when I create a project through hadoop it
shouldn't cry for the missing hbase classes. The way hadoop plugin adds all
the required jars when I create map reduce project, similarly I should have
hbase files available.

So I am looking support for the code level. The link you provided for the
Maven, is able to help till the compiling all the source code. But then I
have to add appropriate jar so that whenever I create project for
hadoop(0.20.205.0) and base(0.90.4) I have all the required jars available.

For the database creation there is tool from Toad but I have not tried yet.

-Jignesh

On Wed, Oct 19, 2011 at 9:43 AM, Doug Meil <[EMAIL PROTECTED]>wrote:

>
> In addition to what Jonathan just said, see
>
> http://hbase.apache.org/book.html#ides
>
>
>
> On 10/19/11 3:05 AM, "Jonathan Gray" <[EMAIL PROTECTED]> wrote:
>
> >Not sure what kind of integration you're talking about, but if just want
> >to create a project with the HBase source then just grab an SVN checkout
> >of an HBase repo and just do:
> >
> >mvn eclipse:eclipse
> >
> >This creates all the necessary project files.  Then just add new project
> >from existing source.
> >
> >That's the extent to which there exists any HBase integration with
> >eclipse that I know of.
> >
> >> -----Original Message-----
> >> From: Jignesh Patel [mailto:[EMAIL PROTECTED]]
> >> Sent: Tuesday, October 18, 2011 11:02 AM
> >> To: [EMAIL PROTECTED]
> >> Subject: integrating hadoop and Hbase with eclipse
> >>
> >> I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't
> >>have
> >> hbase specific jars. By googling I found some articles about only
> >>setting base
> >> but none of them talks about setting up hadoop and hbase with eclipse.
> >>
> >> -jignesh
>
>

Just thinking it may be more easier to refer the hbase lib/jar by creating
map reduce project.
But I don't know in which jar following package exist.

org.apache.hadoop.hbase.
-Jignesh

On Wed, Oct 19, 2011 at 10:14 AM, Jignesh Patel <[EMAIL PROTECTED]>wrote:

> Dough and Jonathan,
> Yes I did follow the steps and with the help of Maven, I have  created
> target folder.
> But that folder doesn't have anything like eclipse plugin. Something
> readily available in hadoop/contrib folder.
>
> What I am looking at this time, when I create a project through hadoop it
> shouldn't cry for the missing hbase classes. The way hadoop plugin adds all
> the required jars when I create map reduce project, similarly I should have
> hbase files available.
>
> So I am looking support for the code level. The link you provided for the
> Maven, is able to help till the compiling all the source code. But then I
> have to add appropriate jar so that whenever I create project for
> hadoop(0.20.205.0) and base(0.90.4) I have all the required jars available.
>
> For the database creation there is tool from Toad but I have not tried yet.
>
> -Jignesh
>
> On Wed, Oct 19, 2011 at 9:43 AM, Doug Meil <[EMAIL PROTECTED]>wrote:
>
>>
>> In addition to what Jonathan just said, see
>>
>> http://hbase.apache.org/book.html#ides
>>
>>
>>
>> On 10/19/11 3:05 AM, "Jonathan Gray" <[EMAIL PROTECTED]> wrote:
>>
>> >Not sure what kind of integration you're talking about, but if just want
>> >to create a project with the HBase source then just grab an SVN checkout
>> >of an HBase repo and just do:
>> >
>> >mvn eclipse:eclipse
>> >
>> >This creates all the necessary project files.  Then just add new project
>> >from existing source.
>> >
>> >That's the extent to which there exists any HBase integration with
>> >eclipse that I know of.
>> >
>> >> -----Original Message-----
>> >> From: Jignesh Patel [mailto:[EMAIL PROTECTED]]
>> >> Sent: Tuesday, October 18, 2011 11:02 AM
>> >> To: [EMAIL PROTECTED]
>> >> Subject: integrating hadoop and Hbase with eclipse
>> >>
>> >> I am able to integrate hadoop 0.20.205.0 with eclipse. But it doesn't
>> >>have
>> >> hbase specific jars. By googling I found some articles about only
>> >>setting base
>> >> but none of them talks about setting up hadoop and hbase with eclipse.
>> >>
>> >> -jignesh
>>
>>
>

After compiling with with maven, I started getting back the following error.

2011-10-19 14:02:38,089 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.io.IOException: Call to localhost/127.0.0.1:9000 failed on local
exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
at org.apache.hadoop.ipc.Client.call(Client.java:743)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at $Proxy6.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:113)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:215)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:177)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:364)
at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:81)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:346)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:282)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:193)
at java.lang.Thread.run(Thread.java:680)
Caused by: java.io.EOFException
However, the hadoop-hbase still shows that I have
required hadoop-core-0.20.205.0.jar in the path.

The only change I see in the folder are creation of build and target folder
as well as .m2 folder at different location. Is there anything changed
because I used mvn install command.

On Wed, Oct 19, 2011 at 11:25 AM, Jignesh Patel <[EMAIL PROTECTED]>wrote:

> Just thinking it may be more easier to refer the hbase lib/jar by creating
> map reduce project.
> But I don't know in which jar following package exist.
>
> org.apache.hadoop.hbase.
>
>
> -Jignesh
>
> On Wed, Oct 19, 2011 at 10:14 AM, Jignesh Patel <[EMAIL PROTECTED]>wrote:
>
>> Dough and Jonathan,
>> Yes I did follow the steps and with the help of Maven, I have  created
>> target folder.
>> But that folder doesn't have anything like eclipse plugin. Something
>> readily available in hadoop/contrib folder.
>>
>> What I am looking at this time, when I create a project through hadoop it
>> shouldn't cry for the missing hbase classes. The way hadoop plugin adds all
>> the required jars when I create map reduce project, similarly I should have
>> hbase files available.
>>
>> So I am looking support for the code level. The link you provided for the
>> Maven, is able to help till the compiling all the source code. But then I
>> have to add appropriate jar so that whenever I create project for
>> hadoop(0.20.205.0) and base(0.90.4) I have all the required jars available.
>>
>> For the database creation there is tool from Toad but I have not tried
>> yet.
>>
>> -Jignesh
>>
>> On Wed, Oct 19, 2011 at 9:43 AM, Doug Meil <[EMAIL PROTECTED]
>> > wrote:
>>
>>>
>>> In addition to what Jonathan just said, see
>>>
>>> http://hbase.apache.org/book.html#ides
>>>
>>>
>>>
>>> On 10/19/11 3:05 AM, "Jonathan Gray" <[EMAIL PROTECTED]> wrote:
>>>
>>> >Not sure what kind of integration you're talking about, but if just want
>>> >to create a project with the HBase source then just grab an SVN checkout
>>> >of an HBase repo and just do:
>>> >
>>> >mvn eclipse:eclipse
>>> >
>>> >This creates all the necessary project files.  Then just add new project
>>> >from existing source.
>>> >
>>> >That's the extent to which there exists any HBase integration with
>>> >eclipse that I know of.
>>> >
>>> >> -----Original Message-----
>>> >> From: Jignesh Patel [mailto:[EMAIL PROTECTED]]

just figured out that while running start-hbase.sh it is taking files from
~/.m2/repository then usual hadoop-hbase/lib.

What I need to change so that it will take the files only from
hadoop-hbase/lib. Because repository has hadoop-core append file which is
not matching with mine hadoop-core-2.205.0.jar

-Jignesh

On Wed, Oct 19, 2011 at 2:37 PM, Jignesh Patel <[EMAIL PROTECTED]>wrote:

> After compiling with with maven, I started getting back the following
> error.
>
> 2011-10-19 14:02:38,089 FATAL org.apache.hadoop.hbase.master.HMaster:
> Unhandled exception. Starting shutdown.
> java.io.IOException: Call to localhost/127.0.0.1:9000 failed on local
> exception: java.io.EOFException
>  at org.apache.hadoop.ipc.Client.wrapException(Client.java:775)
> at org.apache.hadoop.ipc.Client.call(Client.java:743)
>  at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
> at $Proxy6.getProtocolVersion(Unknown Source)
>  at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:359)
> at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:113)
>  at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:215)
> at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:177)
>  at
> org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:82)
> at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
>  at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1390)
>  at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:196)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
>  at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:364)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:81)
>  at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:346)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:282)
>  at
> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:193)
> at java.lang.Thread.run(Thread.java:680)
> Caused by: java.io.EOFException
>
>
> However, the hadoop-hbase still shows that I have
> required hadoop-core-0.20.205.0.jar in the path.
>
> The only change I see in the folder are creation of build and target folder
> as well as .m2 folder at different location. Is there anything changed
> because I used mvn install command.
>
>
> On Wed, Oct 19, 2011 at 11:25 AM, Jignesh Patel <[EMAIL PROTECTED]>wrote:
>
>> Just thinking it may be more easier to refer the hbase lib/jar by creating
>> map reduce project.
>> But I don't know in which jar following package exist.
>>
>> org.apache.hadoop.hbase.
>>
>>
>> -Jignesh
>>
>> On Wed, Oct 19, 2011 at 10:14 AM, Jignesh Patel <[EMAIL PROTECTED]>wrote:
>>
>>> Dough and Jonathan,
>>> Yes I did follow the steps and with the help of Maven, I have  created
>>> target folder.
>>> But that folder doesn't have anything like eclipse plugin. Something
>>> readily available in hadoop/contrib folder.
>>>
>>> What I am looking at this time, when I create a project through hadoop it
>>> shouldn't cry for the missing hbase classes. The way hadoop plugin adds all
>>> the required jars when I create map reduce project, similarly I should have
>>> hbase files available.
>>>
>>> So I am looking support for the code level. The link you provided for the
>>> Maven, is able to help till the compiling all the source code. But then I
>>> have to add appropriate jar so that whenever I create project for
>>> hadoop(0.20.205.0) and base(0.90.4) I have all the required jars available.
>>>
>>> For the database creation there is tool from Toad but I have not tried
>>> yet.
>>>
>>> -Jignesh
>>>
>>> On Wed, Oct 19, 2011 at 9:43 AM, Doug Meil <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>>
>>>> In addition to what Jonathan just said, see
>>>>
>>>> http://hbase.apache.org/book.html#ides
>>>>
>>>>
>>>>
>>>> On 10/19/11 3:05 AM, "Jonathan Gray" <[EMAIL PROTECTED]> wrote:

On Wed, Oct 19, 2011 at 1:10 PM, Jignesh Patel <[EMAIL PROTECTED]> wrote:
> just figured out that while running start-hbase.sh it is taking files from
> ~/.m2/repository then usual hadoop-hbase/lib.
>
> What I need to change so that it will take the files only from
> hadoop-hbase/lib. Because repository has hadoop-core append file which is
> not matching with mine hadoop-core-2.205.0.jar
>

Change the hadoop version in your pom.
St.Ack

St.Ack,

changin hadoop-version in pom.xml doesn't help as during runtime it still
tries to load from m2./repository folder. Is there a way where I can say
that don't go to .m2/repository folder but goto /lib directory.

-jignesh

On Wed, Oct 19, 2011 at 4:42 PM, Stack <[EMAIL PROTECTED]> wrote:

> On Wed, Oct 19, 2011 at 1:10 PM, Jignesh Patel <[EMAIL PROTECTED]>
> wrote:
> > just figured out that while running start-hbase.sh it is taking files
> from
> > ~/.m2/repository then usual hadoop-hbase/lib.
> >
> > What I need to change so that it will take the files only from
> > hadoop-hbase/lib. Because repository has hadoop-core append file which is
> > not matching with mine hadoop-core-2.205.0.jar
> >
>
> Change the hadoop version in your pom.
> St.Ack
>

On Wed, Oct 19, 2011 at 2:19 PM, Jignesh Patel <[EMAIL PROTECTED]> wrote:
> St.Ack,
>
> changin hadoop-version in pom.xml doesn't help as during runtime it still
> tries to load from m2./repository folder. Is there a way where I can say
> that don't go to .m2/repository folder but goto /lib directory.
>

You can rig maven to use explicit dir for a particular jar  -- set its
scope=system [1] -- rather than read from .m2.

Or just change the pom and do a command line build and it will pull
down 205 from maven repository into your .m2 repo (There is likely a
way to do this from eclipse maven plugin too but I've not used it).
Do your mvn eclipse:eclipse and you should be good to go then.

St.Ack

1. http://stackoverflow.com/questions/364114/can-i-add-jars-to-maven-2-build-classpath-without-installing-them