Hi,

We are trying to upgrade hive from 0.9.0 to 0.10.0 (apache). When we deploy
the 0.10.0 binaries and start meta thrift server, we got the following
error:

hadoop@ip-10-4-106-145:~/hive$ ./bin/hive --service metastore
Starting Hive Metastore Server
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
files.
java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
    at
org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
    at
org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:601)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Exception in thread "main" java.lang.NoSuchFieldError:
METASTORE_USE_THRIFT_FRAMED_TRANSPORT
    at
org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
    at
org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:601)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Any clue what's going on here?

Thanks,
Shanzhong

You have to upgrade the existing metastore, although I'm not sure this is
the cause. Did you do that?

See the README in the Hive installation directory and scripts to do the
upgrade in scripts/metastore/upgrade.

dean

On Thu, Mar 14, 2013 at 3:51 AM, Shangzhong zhu <[EMAIL PROTECTED]> wrote:

> Hi,
>
> We are trying to upgrade hive from 0.9.0 to 0.10.0 (apache). When we
> deploy the 0.10.0 binaries and start meta thrift server, we got the
> following error:
>
> hadoop@ip-10-4-106-145:~/hive$ ./bin/hive --service metastore
> Starting Hive Metastore Server
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
> files.
> java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>     at
> org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>     at
> org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:601)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Exception in thread "main" java.lang.NoSuchFieldError:
> METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>     at
> org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>     at
> org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:601)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Any clue what's going on here?
>
> Thanks,
> Shanzhong
>

--
*Dean Wampler, Ph.D.*
thinkbiganalytics.com
+1-312-339-1330

We did upgrade the 0.9.0 metastore DB. In fact, we also tried to start with
an empty DB. But still had this issue.

By looking at the errors, seems the exception was thrown by reading some
configuration settings:

 boolean useFramedTransport conf.getBoolVar(ConfVars.METASTORE_USE_THRIFT_FRAMED_TRANSPORT);
//HiveMetaStore.java:4178

Complaining java.lang.NoSuchFieldError:
METASTORE_USE_THRIFT_FRAMED_TRANSPORT

Any clue what is going on here?

Thanks
On Thu, Mar 14, 2013 at 5:42 AM, Dean Wampler <
[EMAIL PROTECTED]> wrote:

> You have to upgrade the existing metastore, although I'm not sure this is
> the cause. Did you do that?
>
> See the README in the Hive installation directory and scripts to do the
> upgrade in scripts/metastore/upgrade.
>
> dean
>
>
> On Thu, Mar 14, 2013 at 3:51 AM, Shangzhong zhu <[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> We are trying to upgrade hive from 0.9.0 to 0.10.0 (apache). When we
>> deploy the 0.10.0 binaries and start meta thrift server, we got the
>> following error:
>>
>> hadoop@ip-10-4-106-145:~/hive$ ./bin/hive --service metastore
>> Starting Hive Metastore Server
>> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please
>> use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties
>> files.
>> java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>     at java.lang.reflect.Method.invoke(Method.java:601)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>> Exception in thread "main" java.lang.NoSuchFieldError:
>> METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>>     at
>> org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>     at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>     at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>     at java.lang.reflect.Method.invoke(Method.java:601)
>>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>>
>> Any clue what's going on here?
>>
>> Thanks,
>> Shanzhong
>>
>
>
>
> --
> *Dean Wampler, Ph.D.*
> thinkbiganalytics.com
> +1-312-339-1330
>
>

Hi Shangzhong,

Usually after the upgrade that you have done there will be hive upgrade script for the metadata that needs to executed. Try to search for it in the hive libs. Once you obtain the script run it against the metastore DB.

Hope this helps.

On Mar 14, 2013, at 10:05 AM, Shangzhong zhu <[EMAIL PROTECTED]> wrote:

> We did upgrade the 0.9.0 metastore DB. In fact, we also tried to start with an empty DB. But still had this issue.
>
> By looking at the errors, seems the exception was thrown by reading some configuration settings:
>
>  boolean useFramedTransport = conf.getBoolVar(ConfVars.METASTORE_USE_THRIFT_FRAMED_TRANSPORT); //HiveMetaStore.java:4178
>
> Complaining java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>
> Any clue what is going on here?
>
> Thanks
>
>
>
>
> On Thu, Mar 14, 2013 at 5:42 AM, Dean Wampler <[EMAIL PROTECTED]> wrote:
> You have to upgrade the existing metastore, although I'm not sure this is the cause. Did you do that?
>
> See the README in the Hive installation directory and scripts to do the upgrade in scripts/metastore/upgrade.
>
> dean
>
>
> On Thu, Mar 14, 2013 at 3:51 AM, Shangzhong zhu <[EMAIL PROTECTED]> wrote:
> Hi,
>
> We are trying to upgrade hive from 0.9.0 to 0.10.0 (apache). When we deploy the 0.10.0 binaries and start meta thrift server, we got the following error:
>
> hadoop@ip-10-4-106-145:~/hive$ ./bin/hive --service metastore
> Starting Hive Metastore Server
> WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
> java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:601)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Exception in thread "main" java.lang.NoSuchFieldError: METASTORE_USE_THRIFT_FRAMED_TRANSPORT
>     at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:4178)
>     at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:4138)
>     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:601)
>     at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
>
> Any clue what's going on here?
>
> Thanks,
> Shanzhong
>
>
>
> --
> Dean Wampler, Ph.D.
> thinkbiganalytics.com
> +1-312-339-1330
>
>