-RE: Limit to columns or nesting of Hive table?
Connell, Chuck 2012-10-04, 16:08
Thanks. So is the nesting limit 10 now? Does your 2nd paragraph mean that this limit cannot easily be raised?
From: Edward Capriolo [mailto:[EMAIL PROTECTED]]
Sent: Thursday, October 04, 2012 11:57 AM
To: [EMAIL PROTECTED]
Subject: Re: Limit to columns or nesting of Hive table?
There is an open jira ticket on this. There is a hard coded limit but it could be raised with some mostly minor code changes.
One of the bigger problems is that hive stores the definition of a column in JDBC "column" and for some databases larger nested structs can case issues.
On Thu, Oct 4, 2012 at 11:48 AM, Connell, Chuck <[EMAIL PROTECTED]> wrote:
> I am trying to create a large Hive table, with many columns and deeply
> nested structs. It is failing with java.lang.ArrayIndexOutOfBoundsException:
> Before I spend a lot of time debugging my table declaration, is there
> some limit here I should know about? Max number of columns? Max depth
> of struct nesting?