Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> unable to spill content to disk warning

Copy link to this message
RE: unable to spill content to disk warning
This is a warning with the correct message. This warning could
potentially lead to out of memory and/or out of (temporary) disk space
errors. If there are no such errors, it is safe to assume that the
computations completed successfully.


-----Original Message-----
From: Chris Olston [mailto:[EMAIL PROTECTED]]
Sent: Monday, March 30, 2009 2:40 PM
Cc: Peter Mika
Subject: unable to spill content to disk warning

Pig folks,

Is this a cause of concern?:

09/03/30 22:15:51 WARN mapReduceLayer.PigHadoopLogger:
org.apache.pig.data.SortedDataBag: Unable to spill contents to disk

The "WARN" status implies that it's not a fatal problem, but the message
content is pretty worrisome. Should a user be concerned if they see
(If so, does it mean there's insufficient swap space? And if not,
the message can be re-worded :)


Christopher Olston, Ph.D.
Sr. Research Scientist
Yahoo! Research