Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Hive regex SerDe issue?


Copy link to this message
-
Re: Hive regex SerDe issue?
I appreciate the feedback.  I'll check in the morning.  We're running
64bit Ubuntu 10.04 LTS server and I 'believe' it should all be 64 bit
but I'll verify that.

Thanks !!

On 04/13/2011 08:31 PM, Lance Norskog wrote:
> . Usually this is a positive-integer problem somewhere. If you use a
> 32-bit Java this would be a problem.
>
> On Wed, Apr 13, 2011 at 3:16 PM, hadoopman<[EMAIL PROTECTED]>  wrote:
>    
>> Is there an issue with using the regex SerDe with loading into Hive text
>> files above 2 gigs in size?  I've been experiencing out of memory errors
>> with a select group of logs when running a hive job.  I have been able to
>> load the data if I use split to cut it in half or thirds.  No problem.
>>
>> Googling around and figured I'd ask while I'm digging into this.
>>
>> Thanks!
>>
>>      
>
>
>