Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> unable to spill content to disk warning


Copy link to this message
-
RE: unable to spill content to disk warning
This is a warning with the correct message. This warning could
potentially lead to out of memory and/or out of (temporary) disk space
errors. If there are no such errors, it is safe to assume that the
computations completed successfully.

Santhosh

-----Original Message-----
From: Chris Olston [mailto:[EMAIL PROTECTED]]
Sent: Monday, March 30, 2009 2:40 PM
To: [EMAIL PROTECTED]
Cc: Peter Mika
Subject: unable to spill content to disk warning

Pig folks,

Is this a cause of concern?:

09/03/30 22:15:51 WARN mapReduceLayer.PigHadoopLogger:
org.apache.pig.data.SortedDataBag: Unable to spill contents to disk

The "WARN" status implies that it's not a fatal problem, but the message
content is pretty worrisome. Should a user be concerned if they see
this?
(If so, does it mean there's insufficient swap space? And if not,
perhaps
the message can be re-worded :)

-Chris

--
Christopher Olston, Ph.D.
Sr. Research Scientist
Yahoo! Research
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB