|
|
-
Re: File to large Error when MRAndy Isaacson 2012-11-05, 18:13
Moving the thread to user@. The general@ list is not used for
technical questions. On Fri, Nov 2, 2012 at 1:59 AM, zjl208399617 <[EMAIL PROTECTED]> wrote: > When i running Hive query option: > there often throw Error from Reduce Tasks: > > Error: java.io.IOException: File too large > at java.io.FileOutputStream.writeBytes(Native Method) This error is EFBIG from your filesystem. Either the file is too large for your filesystem, or your job is trying to write to an invalid large offset in the file. What filesystem are you using? If it is ext3/4 the maximum filesize is 2TB. If you are using FAT/msdos the maximum file size is 4GB. -andy |