Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # dev >> Pig 0.10 on YARN


I am trying to run TestPigTest against a fanctional Hadoop 2.0 YARN cluster -
I can run MR jobs using Hive or plain MR examples. However, it is going
somewhat unsuccessful. While using pig "far" jar file - e.g. with everything
repacked inside of it - I seeminly can run TestPigTest against a real cluster.

However, while using pig-withouthadoop.jar and adding all needed dependencies
to the classpath, Pig is failing to communicate with YARN nor submit any MR
jobs. There's no exceptions, not error messages anywhere in the logs. Have
anyone seen anything similar?

Any input is highly appreciated!

With regards,
Dmitriy Ryaboy 2013-03-29, 16:08
Konstantin Boudnik 2013-03-29, 17:38
Dmitriy Ryaboy 2013-03-29, 18:52
Konstantin Boudnik 2013-03-29, 21:54
Johnny Zhang 2013-03-29, 22:25
Konstantin Boudnik 2013-03-29, 22:45
Konstantin Boudnik 2013-04-09, 06:41