Hive, mail # user - Re: [ANNOUNCE] Hive 0.5.0 released

Re: [ANNOUNCE] Hive 0.5.0 released

Ryan LeCompte 2010-02-24, 15:40

I actually just tried doing this (using same metastoredb, just using 0.5.0
release code), and now when I execute a simple query it immediately fails
with the following in hive.log:

2010-02-24 10:39:31,950 WARN mapred.JobClient
(JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
for parsing the arguments. Applications should implement Tool for the same.
2010-02-24 10:39:33,535 ERROR exec.ExecDriver
(SessionState.java:printError(248)) - Ended Job = job_201002241035_0002 with
errors
2010-02-24 10:39:33,555 ERROR ql.Driver (SessionState.java:printError(248))
- FAILED: Execution Error, return code 2 from
org.apache.hadoop.hive.ql.exec.ExecDriver

Any ideas how to get this working?

Thanks,
Ryan
On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar <[EMAIL PROTECTED]>wrote:

> Is it compatible with release-0.4.1-rc2 so I can just replace the code?
>
> -----Original Message-----
> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
> Sent: Wednesday, February 24, 2010 3:34 AM
> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> Subject: [ANNOUNCE] Hive 0.5.0 released
>
> Hi folks,
>
> We have released Hive 0.5.0.
> You can find it from the download page in 24 hours (still waiting to
> be mirrored)
>
> http://hadoop.apache.org/hive/releases.html#Download
>
> --
> Yours,
> Zheng
>

Re: [ANNOUNCE] Hive 0.5.0 released

Ryan LeCompte 2010-02-24, 15:43

Actually, I just fixed the problem by removing the following in
hive-site.xml:

<property>
<name>hive.input.format</name>
<value>org.apache.hadoop.hive.ql.io.CombineHiveInputFormat</value>
</property>
Any reason why specifying the above would cause the error? We are using
latest version of Hadoop.

Thanks,
Ryan
On Wed, Feb 24, 2010 at 10:40 AM, Ryan LeCompte <[EMAIL PROTECTED]> wrote:

> I actually just tried doing this (using same metastoredb, just using 0.5.0
> release code), and now when I execute a simple query it immediately fails
> with the following in hive.log:
>
> 2010-02-24 10:39:31,950 WARN mapred.JobClient
> (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser
> for parsing the arguments. Applications should implement Tool for the same.
> 2010-02-24 10:39:33,535 ERROR exec.ExecDriver
> (SessionState.java:printError(248)) - Ended Job = job_201002241035_0002 with
> errors
> 2010-02-24 10:39:33,555 ERROR ql.Driver (SessionState.java:printError(248))
> - FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.ExecDriver
>
> Any ideas how to get this working?
>
> Thanks,
> Ryan
>
>
>
> On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar <[EMAIL PROTECTED]>wrote:
>
>> Is it compatible with release-0.4.1-rc2 so I can just replace the code?
>>
>> -----Original Message-----
>> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
>> Sent: Wednesday, February 24, 2010 3:34 AM
>> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
>> Subject: [ANNOUNCE] Hive 0.5.0 released
>>
>> Hi folks,
>>
>> We have released Hive 0.5.0.
>> You can find it from the download page in 24 hours (still waiting to
>> be mirrored)
>>
>> http://hadoop.apache.org/hive/releases.html#Download
>>
>> --
>> Yours,
>> Zheng
>>
>
>

Re: [ANNOUNCE] Hive 0.5.0 released

Zheng Shao 2010-02-24, 17:50

Thanks for the feedback.

Which exact version of hadoop are you using?

There is a bug in hadoop combinefileinputformat that was fixed recently.

Zheng
On 2/24/10, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
> Actually, I just fixed the problem by removing the following in
> hive-site.xml:
>
> <property>
> <name>hive.input.format</name>
> <value>org.apache.hadoop.hive.ql.io.CombineHiveInputFormat</value>
> </property>
>
>
> Any reason why specifying the above would cause the error? We are using
> latest version of Hadoop.
>
> Thanks,
> Ryan
>
>
> On Wed, Feb 24, 2010 at 10:40 AM, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
>
>> I actually just tried doing this (using same metastoredb, just using 0.5.0
>> release code), and now when I execute a simple query it immediately fails
>> with the following in hive.log:
>>
>> 2010-02-24 10:39:31,950 WARN mapred.JobClient
>> (JobClient.java:configureCommandLineOptions(539)) - Use
>> GenericOptionsParser
>> for parsing the arguments. Applications should implement Tool for the
>> same.
>> 2010-02-24 10:39:33,535 ERROR exec.ExecDriver
>> (SessionState.java:printError(248)) - Ended Job = job_201002241035_0002
>> with
>> errors
>> 2010-02-24 10:39:33,555 ERROR ql.Driver
>> (SessionState.java:printError(248))
>> - FAILED: Execution Error, return code 2 from
>> org.apache.hadoop.hive.ql.exec.ExecDriver
>>
>> Any ideas how to get this working?
>>
>> Thanks,
>> Ryan
>>
>>
>>
>> On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar
>> <[EMAIL PROTECTED]>wrote:
>>
>>> Is it compatible with release-0.4.1-rc2 so I can just replace the code?
>>>
>>> -----Original Message-----
>>> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
>>> Sent: Wednesday, February 24, 2010 3:34 AM
>>> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
>>> Subject: [ANNOUNCE] Hive 0.5.0 released
>>>
>>> Hi folks,
>>>
>>> We have released Hive 0.5.0.
>>> You can find it from the download page in 24 hours (still waiting to
>>> be mirrored)
>>>
>>> http://hadoop.apache.org/hive/releases.html#Download
>>>
>>> --
>>> Yours,
>>> Zheng
>>>
>>
>>
>

--
Sent from my mobile device

Yours,
Zheng

Re: [ANNOUNCE] Hive 0.5.0 released

Ryan LeCompte 2010-02-24, 18:17

Ah, interesting.

Using Hadoop 0.20.1. Is this the problematic version?

Thanks,
Ryan
On Wed, Feb 24, 2010 at 12:50 PM, Zheng Shao <[EMAIL PROTECTED]> wrote:

> Thanks for the feedback.
>
> Which exact version of hadoop are you using?
>
> There is a bug in hadoop combinefileinputformat that was fixed recently.
>
> Zheng
>
>
> On 2/24/10, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
> > Actually, I just fixed the problem by removing the following in
> > hive-site.xml:
> >
> > <property>
> > <name>hive.input.format</name>
> > <value>org.apache.hadoop.hive.ql.io.CombineHiveInputFormat</value>
> > </property>
> >
> >
> > Any reason why specifying the above would cause the error? We are using
> > latest version of Hadoop.
> >
> > Thanks,
> > Ryan
> >
> >
> > On Wed, Feb 24, 2010 at 10:40 AM, Ryan LeCompte <[EMAIL PROTECTED]>
> wrote:
> >
> >> I actually just tried doing this (using same metastoredb, just using
> 0.5.0
> >> release code), and now when I execute a simple query it immediately
> fails
> >> with the following in hive.log:
> >>
> >> 2010-02-24 10:39:31,950 WARN mapred.JobClient
> >> (JobClient.java:configureCommandLineOptions(539)) - Use
> >> GenericOptionsParser
> >> for parsing the arguments. Applications should implement Tool for the
> >> same.
> >> 2010-02-24 10:39:33,535 ERROR exec.ExecDriver
> >> (SessionState.java:printError(248)) - Ended Job = job_201002241035_0002
> >> with
> >> errors
> >> 2010-02-24 10:39:33,555 ERROR ql.Driver
> >> (SessionState.java:printError(248))
> >> - FAILED: Execution Error, return code 2 from
> >> org.apache.hadoop.hive.ql.exec.ExecDriver
> >>
> >> Any ideas how to get this working?
> >>
> >> Thanks,
> >> Ryan
> >>
> >>
> >>
> >> On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar
> >> <[EMAIL PROTECTED]>wrote:
> >>
> >>> Is it compatible with release-0.4.1-rc2 so I can just replace the code?
> >>>
> >>> -----Original Message-----
> >>> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
> >>> Sent: Wednesday, February 24, 2010 3:34 AM
> >>> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> >>> Subject: [ANNOUNCE] Hive 0.5.0 released
> >>>
> >>> Hi folks,
> >>>
> >>> We have released Hive 0.5.0.
> >>> You can find it from the download page in 24 hours (still waiting to
> >>> be mirrored)
> >>>
> >>> http://hadoop.apache.org/hive/releases.html#Download
> >>>
> >>> --
> >>> Yours,
> >>> Zheng
> >>>
> >>
> >>
> >
>
> --
> Sent from my mobile device
>
> Yours,
> Zheng
>

Re: [ANNOUNCE] Hive 0.5.0 released

Zheng Shao 2010-02-24, 18:31

Yes, see
http://issues.apache.org/jira/browse/HADOOP-5759?page=com.atlassian.jira.plugin.ext.subversion:subversion-commits-tabpanel

The fix is committed to Hadoop 0.20.2 and 0.21.0.
But you can continue to use Hive 0.5.0 if you remove that configuration.

Zheng

On Wed, Feb 24, 2010 at 10:17 AM, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
> Ah, interesting.
>
> Using Hadoop 0.20.1. Is this the problematic version?
>
> Thanks,
> Ryan
>
>
> On Wed, Feb 24, 2010 at 12:50 PM, Zheng Shao <[EMAIL PROTECTED]> wrote:
>>
>> Thanks for the feedback.
>>
>> Which exact version of hadoop are you using?
>>
>> There is a bug in hadoop combinefileinputformat that was fixed recently.
>>
>> Zheng
>>
>>
>> On 2/24/10, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
>> > Actually, I just fixed the problem by removing the following in
>> > hive-site.xml:
>> >
>> > <property>
>> > <name>hive.input.format</name>
>> > <value>org.apache.hadoop.hive.ql.io.CombineHiveInputFormat</value>
>> > </property>
>> >
>> >
>> > Any reason why specifying the above would cause the error? We are using
>> > latest version of Hadoop.
>> >
>> > Thanks,
>> > Ryan
>> >
>> >
>> > On Wed, Feb 24, 2010 at 10:40 AM, Ryan LeCompte <[EMAIL PROTECTED]>
>> > wrote:
>> >
>> >> I actually just tried doing this (using same metastoredb, just using
>> >> 0.5.0
>> >> release code), and now when I execute a simple query it immediately
>> >> fails
>> >> with the following in hive.log:
>> >>
>> >> 2010-02-24 10:39:31,950 WARN mapred.JobClient
>> >> (JobClient.java:configureCommandLineOptions(539)) - Use
>> >> GenericOptionsParser
>> >> for parsing the arguments. Applications should implement Tool for the
>> >> same.
>> >> 2010-02-24 10:39:33,535 ERROR exec.ExecDriver
>> >> (SessionState.java:printError(248)) - Ended Job = job_201002241035_0002
>> >> with
>> >> errors
>> >> 2010-02-24 10:39:33,555 ERROR ql.Driver
>> >> (SessionState.java:printError(248))
>> >> - FAILED: Execution Error, return code 2 from
>> >> org.apache.hadoop.hive.ql.exec.ExecDriver
>> >>
>> >> Any ideas how to get this working?
>> >>
>> >> Thanks,
>> >> Ryan
>> >>
>> >>
>> >>
>> >> On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar
>> >> <[EMAIL PROTECTED]>wrote:
>> >>
>> >>> Is it compatible with release-0.4.1-rc2 so I can just replace the
>> >>> code?
>> >>>
>> >>> -----Original Message-----
>> >>> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
>> >>> Sent: Wednesday, February 24, 2010 3:34 AM
>> >>> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
>> >>> Subject: [ANNOUNCE] Hive 0.5.0 released
>> >>>
>> >>> Hi folks,
>> >>>
>> >>> We have released Hive 0.5.0.
>> >>> You can find it from the download page in 24 hours (still waiting to
>> >>> be mirrored)
>> >>>
>> >>> http://hadoop.apache.org/hive/releases.html#Download
>> >>>
>> >>> --
>> >>> Yours,
>> >>> Zheng
>> >>>
>> >>
>> >>
>> >
>>
>> --
>> Sent from my mobile device
>>
>> Yours,
>> Zheng
>
>

--
Yours,
Zheng

Re: [ANNOUNCE] Hive 0.5.0 released

Ryan LeCompte 2010-02-24, 18:35

Got it, thanks!

On Wed, Feb 24, 2010 at 1:31 PM, Zheng Shao <[EMAIL PROTECTED]> wrote:

> Yes, see
>
> http://issues.apache.org/jira/browse/HADOOP-5759?page=com.atlassian.jira.plugin.ext.subversion:subversion-commits-tabpanel
>
> The fix is committed to Hadoop 0.20.2 and 0.21.0.
>
>
> But you can continue to use Hive 0.5.0 if you remove that configuration.
>
> Zheng
>
> On Wed, Feb 24, 2010 at 10:17 AM, Ryan LeCompte <[EMAIL PROTECTED]>
> wrote:
> > Ah, interesting.
> >
> > Using Hadoop 0.20.1. Is this the problematic version?
> >
> > Thanks,
> > Ryan
> >
> >
> > On Wed, Feb 24, 2010 at 12:50 PM, Zheng Shao <[EMAIL PROTECTED]> wrote:
> >>
> >> Thanks for the feedback.
> >>
> >> Which exact version of hadoop are you using?
> >>
> >> There is a bug in hadoop combinefileinputformat that was fixed recently.
> >>
> >> Zheng
> >>
> >>
> >> On 2/24/10, Ryan LeCompte <[EMAIL PROTECTED]> wrote:
> >> > Actually, I just fixed the problem by removing the following in
> >> > hive-site.xml:
> >> >
> >> > <property>
> >> > <name>hive.input.format</name>
> >> > <value>org.apache.hadoop.hive.ql.io.CombineHiveInputFormat</value>
> >> > </property>
> >> >
> >> >
> >> > Any reason why specifying the above would cause the error? We are
> using
> >> > latest version of Hadoop.
> >> >
> >> > Thanks,
> >> > Ryan
> >> >
> >> >
> >> > On Wed, Feb 24, 2010 at 10:40 AM, Ryan LeCompte <[EMAIL PROTECTED]>
> >> > wrote:
> >> >
> >> >> I actually just tried doing this (using same metastoredb, just using
> >> >> 0.5.0
> >> >> release code), and now when I execute a simple query it immediately
> >> >> fails
> >> >> with the following in hive.log:
> >> >>
> >> >> 2010-02-24 10:39:31,950 WARN mapred.JobClient
> >> >> (JobClient.java:configureCommandLineOptions(539)) - Use
> >> >> GenericOptionsParser
> >> >> for parsing the arguments. Applications should implement Tool for the
> >> >> same.
> >> >> 2010-02-24 10:39:33,535 ERROR exec.ExecDriver
> >> >> (SessionState.java:printError(248)) - Ended Job > job_201002241035_0002
> >> >> with
> >> >> errors
> >> >> 2010-02-24 10:39:33,555 ERROR ql.Driver
> >> >> (SessionState.java:printError(248))
> >> >> - FAILED: Execution Error, return code 2 from
> >> >> org.apache.hadoop.hive.ql.exec.ExecDriver
> >> >>
> >> >> Any ideas how to get this working?
> >> >>
> >> >> Thanks,
> >> >> Ryan
> >> >>
> >> >>
> >> >>
> >> >> On Wed, Feb 24, 2010 at 8:20 AM, Massoud Mazar
> >> >> <[EMAIL PROTECTED]>wrote:
> >> >>
> >> >>> Is it compatible with release-0.4.1-rc2 so I can just replace the
> >> >>> code?
> >> >>>
> >> >>> -----Original Message-----
> >> >>> From: Zheng Shao [mailto:[EMAIL PROTECTED]]
> >> >>> Sent: Wednesday, February 24, 2010 3:34 AM
> >> >>> To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
> >> >>> Subject: [ANNOUNCE] Hive 0.5.0 released
> >> >>>
> >> >>> Hi folks,
> >> >>>
> >> >>> We have released Hive 0.5.0.
> >> >>> You can find it from the download page in 24 hours (still waiting to
> >> >>> be mirrored)
> >> >>>
> >> >>> http://hadoop.apache.org/hive/releases.html#Download
> >> >>>
> >> >>> --
> >> >>> Yours,
> >> >>> Zheng
> >> >>>
> >> >>
> >> >>
> >> >
> >>
> >> --
> >> Sent from my mobile device
> >>
> >> Yours,
> >> Zheng
> >
> >
>
>
>
> --
> Yours,
> Zheng
>