-Re: Problem with the windowing function ntile (Exceptions)
Lars Francke 2013-07-25, 17:30
that's awesome! Thank you for the quick response and the patch. I just
tested it against my query which used to fail and it just worked. So
you have at least my thumbs-up.
Thanks again for your help.
On Thu, Jul 25, 2013 at 10:01 AM, Navis류승우 <[EMAIL PROTECTED]> wrote:
> I've booked this and attached patch for it.
> Could you test with that? thanks.
> 2013/7/25 Lars Francke <[EMAIL PROTECTED]>:
>> We're still being bitten by this problem without a workaround. Does
>> anyone have an idea?
>> On Wed, Jul 17, 2013 at 11:24 PM, Lars Francke <[EMAIL PROTECTED]> wrote:
>>> I'm running a query like this:
>>> CREATE TABLE foo
>>> STORED AS ORC
>>> OVER (
>>> PARTITION BY season
>>> ORDER BY amount DESC
>>> FROM bar;
>>> On a small enough dataset that works fine but when switching to a
>>> larger sample we're seeing exceptions like this:
>>> "Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Reset on
>>> PersistentByteBasedList not supported"
>>> Looking at the code (without really understanding it) we tried setting:
>>> SET hive.ptf.partition.persistence='org.apache.hadoop.hive.ql.exec.PTFPersistence$PartitionedByteBasedList';
>>> because that List supports reset but we are seeing a
>>> ClassNotFoundException so we're doing that wrong.
>>> Next try was setting hive.ptf.partition.persistence.memsize higher
>>> which worked but first of all we don't really understand what all of
>>> that stuff is doing and second of all we fear that it just might break
>>> down again.
>>> Any hints as to what that error really means and how to deal with it
>>> would be greatly appreciated.