Bejoy Ks 2011-08-18, 12:51
-Re: Hive crashing after an upgrade - issue with existing larger tables
A small correction to my previous post. The CDH version is CDH u1 not u0
Sorry for the confusion
Bejoy K S
From: Bejoy Ks <[EMAIL PROTECTED]>
Date: Thu, 18 Aug 2011 05:51:58
To: hive user group<[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Hive crashing after an upgrade - issue with existing larger tables
I was working on hive with larger volume data with hive 0.7 . Recently my hive installation was upgraded to 0.7.1 . After the upgrade I'm having a lot of issues with queries that were already working fine with larger data. The queries that took seconds to return results is now taking hours, for most larger tables even the map reduce jobs are not getting triggered. Queries like Select * and describe are working fine since they don't involve any map reduce jobs. For the jobs that didn't even get triggered I got the following error from job tracker
Job initialization failed: java.io.IOException: Split metadata size exceeded 10000000.
Aborting job job_201106061630_6993 at org.apache.hadoop.mapreduce.split.SplitMetaInfoReader.readSplitMetaInfo(SplitMetaInfoReader.java:48)
Looks like some metadata issue. My cluster is on CDH3-u0 . Has anyone faced similar issues before. Please share your thoughts what could be the probable cause of the error.
Carl Steinbach 2011-08-18, 18:26