Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Load multiple files


Copy link to this message
-
Load multiple files
Ankit Bhatnagar 2013-05-09, 22:23
Hi folks,

I wanted to reach out to see if somebody has encountered a similar issue.

Reading multiple file fails with error- (Pig + ozzie)

 

The mapper syslog Error:

g2013-04-24 07:22:45,905 FATAL [main] org.apache.hadoop.mapred.YarnChild:
Error
running child : java.lang.OutOfMemoryError
    at sun.misc.Unsafe.allocateMemory(Native Method)
    at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:127)
    at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)

However the same works while running independently thru command line (Pig
run)
Ankit