Hi All,

Is it possible to install hive on a machine that is not a member of Hadoop cluster (and it does not have hadoop installation on it, i.e. no HADOOP_HOME or its entry in path)?

Thanks,
Keshav
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.

Hive needs the hadoop jars to talk to hadoop. The machine that it is
installed on has to have those jars installed. However, it does not need to
be a "part" of the hadoop cluster in the sense that it does not need to
have a TaskTracker or DataNode running. The machine can operate purely as a
client to the hadoop cluster but it needs the hadoop jars to talk to the
hadoop cluster.

Hope that helps...

Ashish

On Wed, Apr 25, 2012 at 12:43 AM, Savant, Keshav <
[EMAIL PROTECTED]> wrote:

>  Hi All,****
>
> ** **
>
> Is it possible to install hive on a machine that is not a member of Hadoop
> cluster (and it does not have hadoop installation on it, i.e. no
> HADOOP_HOME or its entry in path)?****
>
> ** **
>
> Thanks,****
>
> Keshav****
>
> ** **
>
> ** **
>  _____________
> The information contained in this message is proprietary and/or
> confidential. If you are not the intended recipient, please: (i) delete the
> message and all copies; (ii) do not disclose, distribute or use the message
> in any manner; and (iii) notify the sender immediately. In addition, please
> be aware that any message addressed to our domain is subject to archiving
> and review by persons other than the intended recipient. Thank you.
>

Hive client also needs to be able to list paths on hadoop (checks if path
exists etc while creating tables (external too))
I think we should fix this.

On Wed, Apr 25, 2012 at 6:07 AM, Ashish Thusoo <[EMAIL PROTECTED]> wrote:

> Hive needs the hadoop jars to talk to hadoop. The machine that it is
> installed on has to have those jars installed. However, it does not need to
> be a "part" of the hadoop cluster in the sense that it does not need to
> have a TaskTracker or DataNode running. The machine can operate purely as a
> client to the hadoop cluster but it needs the hadoop jars to talk to the
> hadoop cluster.
>
> Hope that helps...
>
> Ashish
>
>
> On Wed, Apr 25, 2012 at 12:43 AM, Savant, Keshav <
> [EMAIL PROTECTED]> wrote:
>
>>  Hi All,****
>>
>> ** **
>>
>> Is it possible to install hive on a machine that is not a member of
>> Hadoop cluster (and it does not have hadoop installation on it, i.e. no
>> HADOOP_HOME or its entry in path)?****
>>
>> ** **
>>
>> Thanks,****
>>
>> Keshav****
>>
>> ** **
>>
>> ** **
>>  _____________
>> The information contained in this message is proprietary and/or
>> confidential. If you are not the intended recipient, please: (i) delete the
>> message and all copies; (ii) do not disclose, distribute or use the message
>> in any manner; and (iii) notify the sender immediately. In addition, please
>> be aware that any message addressed to our domain is subject to archiving
>> and review by persons other than the intended recipient. Thank you.
>>
>
>
--
"...:::Aniket:::... Quetzalco@tl"

Hi,

If you are talking about running Hive in local mode without pointing to a
$HADOOP_HOME I don't think it would work even if you include hadoop-core
dependency in Hive classpath since in local mode Hive will use hadoop
scripts present in  $HADOOP_HOME/bin. I came across the same requirement
recently and I got it working by changing the Hive local mode job
submission code a bit to directly invoke hadoop without going through the
hadoop script.

Regards
Buddhika

we have an open ticket to run jobs without bin/hadoop do you care to
share that code?

On Wed, Apr 25, 2012 at 11:56 PM, buddhika chamith
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> If you are talking about running Hive in local mode without pointing to a
> $HADOOP_HOME I don't think it would work even if you include hadoop-core
> dependency in Hive classpath since in local mode Hive will use hadoop
> scripts present in  $HADOOP_HOME/bin. I came across the same requirement
> recently and I got it working by changing the Hive local mode job submission
> code a bit to directly invoke hadoop without going through the hadoop
> script.
>
> Regards
> Buddhika

Thanks Ashish, that was helpful.

Keshav
From: Ashish Thusoo [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 25, 2012 6:37 PM
To: [EMAIL PROTECTED]
Subject: Re: Hive on Standalone Machine

Hive needs the hadoop jars to talk to hadoop. The machine that it is installed on has to have those jars installed. However, it does not need to be a "part" of the hadoop cluster in the sense that it does not need to have a TaskTracker or DataNode running. The machine can operate purely as a client to the hadoop cluster but it needs the hadoop jars to talk to the hadoop cluster.

Hope that helps...

Ashish
On Wed, Apr 25, 2012 at 12:43 AM, Savant, Keshav <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi All,

Is it possible to install hive on a machine that is not a member of Hadoop cluster (and it does not have hadoop installation on it, i.e. no HADOOP_HOME or its entry in path)?

Thanks,
Keshav
_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.

_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.

On Thu, Apr 26, 2012 at 10:07 AM, Edward Capriolo <[EMAIL PROTECTED]>wrote:

> we have an open ticket to run jobs without bin/hadoop do you care to
> share that code?
>

Sure I will provide a patch.

Regards
Buddhika
>
> On Wed, Apr 25, 2012 at 11:56 PM, buddhika chamith
> <[EMAIL PROTECTED]> wrote:
> > Hi,
> >
> > If you are talking about running Hive in local mode without pointing to a
> > $HADOOP_HOME I don't think it would work even if you include hadoop-core
> > dependency in Hive classpath since in local mode Hive will use hadoop
> > scripts present in  $HADOOP_HOME/bin. I came across the same requirement
> > recently and I got it working by changing the Hive local mode job
> submission
> > code a bit to directly invoke hadoop without going through the hadoop
> > script.
> >
> > Regards
> > Buddhika
>

Hi Ed,

On Thu, Apr 26, 2012 at 12:26 PM, buddhika chamith
<[EMAIL PROTECTED]>wrote:

>
>
> On Thu, Apr 26, 2012 at 10:07 AM, Edward Capriolo <[EMAIL PROTECTED]>wrote:
>
>> we have an open ticket to run jobs without bin/hadoop do you care to
>> share that code?
>>
>
> Sure I will provide a patch.
>

Sorry for the delay. Attached a patch to
https://issues.apache.org/jira/browse/HIVE-2757. Hope this was the issue
that you were talking about.

Regards
Buddhika

>
> Regards
> Buddhika
>
>
>>
>> On Wed, Apr 25, 2012 at 11:56 PM, buddhika chamith
>> <[EMAIL PROTECTED]> wrote:
>> > Hi,
>> >
>> > If you are talking about running Hive in local mode without pointing to
>> a
>> > $HADOOP_HOME I don't think it would work even if you include hadoop-core
>> > dependency in Hive classpath since in local mode Hive will use hadoop
>> > scripts present in  $HADOOP_HOME/bin. I came across the same requirement
>> > recently and I got it working by changing the Hive local mode job
>> submission
>> > code a bit to directly invoke hadoop without going through the hadoop
>> > script.
>> >
>> > Regards
>> > Buddhika
>>
>
>

Ok your still building a command line it seems. I assumed you were
working to launch hive without a fork. Pretty cool though.

On Tue, May 1, 2012 at 1:08 PM, buddhika chamith
<[EMAIL PROTECTED]> wrote:
> Hi Ed,
>
> On Thu, Apr 26, 2012 at 12:26 PM, buddhika chamith <[EMAIL PROTECTED]>
> wrote:
>>
>>
>>
>> On Thu, Apr 26, 2012 at 10:07 AM, Edward Capriolo <[EMAIL PROTECTED]>
>> wrote:
>>>
>>> we have an open ticket to run jobs without bin/hadoop do you care to
>>> share that code?
>>
>>
>> Sure I will provide a patch.
>
>
> Sorry for the delay. Attached a patch to
> https://issues.apache.org/jira/browse/HIVE-2757. Hope this was the issue
> that you were talking about.
>
> Regards
> Buddhika
>>
>>
>> Regards
>> Buddhika
>>
>>>
>>>
>>> On Wed, Apr 25, 2012 at 11:56 PM, buddhika chamith
>>> <[EMAIL PROTECTED]> wrote:
>>> > Hi,
>>> >
>>> > If you are talking about running Hive in local mode without pointing to
>>> > a
>>> > $HADOOP_HOME I don't think it would work even if you include
>>> > hadoop-core
>>> > dependency in Hive classpath since in local mode Hive will use hadoop
>>> > scripts present in  $HADOOP_HOME/bin. I came across the same
>>> > requirement
>>> > recently and I got it working by changing the Hive local mode job
>>> > submission
>>> > code a bit to directly invoke hadoop without going through the hadoop
>>> > script.
>>> >
>>> > Regards
>>> > Buddhika
>>
>>
>

Yes. My requirement was to avoid using bin/hadoop. I still required the job
to be run in a new JVM. However I think we can make it run without a fork
with some changes. I will give it a try as well and see.

Regards
Buddhika

On Tue, May 1, 2012 at 11:23 PM, Edward Capriolo <[EMAIL PROTECTED]>wrote:

> Ok your still building a command line it seems. I assumed you were
> working to launch hive without a fork. Pretty cool though.
>
> On Tue, May 1, 2012 at 1:08 PM, buddhika chamith
> <[EMAIL PROTECTED]> wrote:
> > Hi Ed,
> >
> > On Thu, Apr 26, 2012 at 12:26 PM, buddhika chamith <
> [EMAIL PROTECTED]>
> > wrote:
> >>
> >>
> >>
> >> On Thu, Apr 26, 2012 at 10:07 AM, Edward Capriolo <
> [EMAIL PROTECTED]>
> >> wrote:
> >>>
> >>> we have an open ticket to run jobs without bin/hadoop do you care to
> >>> share that code?
> >>
> >>
> >> Sure I will provide a patch.
> >
> >
> > Sorry for the delay. Attached a patch to
> > https://issues.apache.org/jira/browse/HIVE-2757. Hope this was the issue
> > that you were talking about.
> >
> > Regards
> > Buddhika
> >>
> >>
> >> Regards
> >> Buddhika
> >>
> >>>
> >>>
> >>> On Wed, Apr 25, 2012 at 11:56 PM, buddhika chamith
> >>> <[EMAIL PROTECTED]> wrote:
> >>> > Hi,
> >>> >
> >>> > If you are talking about running Hive in local mode without pointing
> to
> >>> > a
> >>> > $HADOOP_HOME I don't think it would work even if you include
> >>> > hadoop-core
> >>> > dependency in Hive classpath since in local mode Hive will use hadoop
> >>> > scripts present in  $HADOOP_HOME/bin. I came across the same
> >>> > requirement
> >>> > recently and I got it working by changing the Hive local mode job
> >>> > submission
> >>> > code a bit to directly invoke hadoop without going through the hadoop
> >>> > script.
> >>> >
> >>> > Regards
> >>> > Buddhika
> >>
> >>
> >
>