Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # dev - [Discussion] Any thoughts on PIG-3457?


Copy link to this message
-
[Discussion] Any thoughts on PIG-3457?
Cheolsoo Park 2013-09-30, 16:51
Hi devs,

PIG-3419 <https://issues.apache.org/jira/browse/PIG-3419> broke backward
compatibility for downstream applications such as Oozie, and
PIG-3457<https://issues.apache.org/jira/browse/PIG-3457> is
trying to fix it.

In summary, we need to keep the old MR-specific JobStats and PigStats for
backward compatibility sadly because they're currently exposed in several
user-facing API including PigRunner, PigServer, etc. However, this defeats
the purpose of PIG-3419
<https://issues.apache.org/jira/browse/PIG-3419> because
we cannot implement non-MR execution engines in the back-end if the
front-end API is tied to MR.

Daniel and I were having a discussion in the jira, but it seems more
complicated than I thought. I am wondering whether anyone has a good
suggestion on how to solve it. This is blocking the 0.12 release.

Thanks,
Cheolsoo
+
Daniel Dai 2013-09-30, 17:33
+
Cheolsoo Park 2013-09-30, 17:43
+
Jeremy Karn 2013-09-30, 18:12
+
Cheolsoo Park 2013-09-30, 18:45
+
Jeremy Karn 2013-09-30, 19:40
+
Daniel Dai 2013-09-30, 19:48
+
Jeremy Karn 2013-09-30, 19:56
+
Pradeep Gollakota 2013-09-30, 20:14
+
Alan Gates 2013-09-30, 20:28
+
Rohini Palaniswamy 2013-09-30, 21:26
+
Cheolsoo Park 2013-09-30, 21:42
+
Aniket Mokashi 2013-09-30, 22:37
+
Cheolsoo Park 2013-09-30, 22:52
+
Cheolsoo Park 2013-10-01, 04:28
+
Daniel Dai 2013-10-01, 05:17