Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> ERROR 2997: Unable to recreate exception from backed error


+
John Morrison 2012-07-13, 15:18
Copy link to this message
-
Re: ERROR 2997: Unable to recreate exception from backed error
Try looking at the JobTracker -- it might have your jobs in the
"failed" group, and it seems like initialization is failing. Click
through to the logs to find the real problem.

D

On Fri, Jul 13, 2012 at 8:18 AM, John Morrison
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Not sure what is going on here.  Trying to get simple pig script to work
> when put on hdfs://
>
> I am able to "hadoop fs -cat" the file but get an error when trying to read
> it in pig?
>
> Any ideas of what is causing this and how to resolve?
>
> I am able to get this working on local file system (see below).
>
> Thanks,
>
> John
>
>
> Details:
>
>
> # Data file
> hadoop fs -cat "hdfs://thadoop2/tmp/v.log"
> 12/07/13 10:23:23 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 1       6
> 2       8
> 3       10
> 4       12
>
>
> # Pig file
>
> cat hdfs_dump.pig
> A = LOAD 'hdfs://thadoop2/tmp/v.log'  AS (x:float,y:float) ;
> dump A;
>
>
> # Pig shell script
>
> cat hdfs_dump.sh
> pig  hdfs_dump.pig  2>&1 | tee $0.out
>
>
> # Run pig shell script
>
> ./hdfs_dump.sh
>
>
>
> # Errors in log output
>
> grep -i err hdfs_dump.sh.out
> 2012-07-13 10:20:51,724 [main] INFO  org.apache.pig.Main - Logging error
> messages to: /apps/dba/hadoop_benchmarks/jhm/pig_1342189251720.log
> 2012-07-13 10:21:11,663 [main] ERROR
> org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to
> recreate exception from backed error: Error initializing
> attempt_201207051157_0016_m_000000_3:
> 2012-07-13 10:21:11,663 [main] ERROR
> org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
> 2012-07-13 10:21:11,680 [main] ERROR org.apache.pig.tools.grunt.Grunt -
> ERROR 2997: Unable to recreate exception from backed error: Error
> initializing attempt_201207051157_0016_m_000000_3:
>
>
>
> # Local version works
>
> # Local data file
> cat v.log
> 1       6
> 2       8
> 3       10
> 4       12
>
> # Local pig script
>
>  cat  local_dump.sh
>
> pig -x local  dump.pig
>
>
> # Local shell script
>
> cat local_dump.sh
>
> pig -x local  dump.pig
>
>
> # Run local shell script
>
>
>  ./local_dump.sh 2>&1 | tail
> job_local_0001
>
>
> 2012-07-13 10:59:58,304 [main] INFO
>  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - Success!
> 2012-07-13 10:59:58,308 [main] INFO
>  org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths
> to process : 1
> 2012-07-13 10:59:58,308 [main] INFO
>  org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total
> input paths to process : 1
> (1.0,6.0)
> (2.0,8.0)
> (3.0,10.0)
> (4.0,12.0)