Hi all,

are there any tools that visualize the data flow in a Pig script, such
as the joins, unions etc.? Maybe somewhat like this:

A   B
  \ /
  C

I imagine that would be very helpful during development of more
complex scripts. It might be done with Graphviz or similar tools. I
couldn't find anything on ther web.

Cheers,
Thomas

Hey Thomas,

Perhaps you're looking for PigPen, the graphical eclipse plugin for Pig?

Ticket: https://issues.apache.org/jira/browse/PIG-366
Wiki: http://wiki.apache.org/pig/PigPen

On Tue, May 17, 2011 at 2:43 PM, Thomas Kappler <[EMAIL PROTECTED]> wrote:
> Hi all,
>
> are there any tools that visualize the data flow in a Pig script, such
> as the joins, unions etc.? Maybe somewhat like this:
>
> A   B
>  \ /
>  C
>
> I imagine that would be very helpful during development of more
> complex scripts. It might be done with Graphviz or similar tools. I
> couldn't find anything on ther web.
>
> Cheers,
> Thomas
>

--
Harsh J

Thanks Harsh, it sounds pretty good. The latest comments on PIG-366
suggest it doesn't work with Pig 0.8+. I couldn't find a repository
for the project, the one on google code is outdated.

Do you know whether one can get it to work with Pig 0.8 or 0.9-branch?

Thanks,
Thomas

On Tue, May 17, 2011 at 13:20, Harsh J <[EMAIL PROTECTED]> wrote:
> Hey Thomas,
>
> Perhaps you're looking for PigPen, the graphical eclipse plugin for Pig?
>
> Ticket: https://issues.apache.org/jira/browse/PIG-366
> Wiki: http://wiki.apache.org/pig/PigPen
>
> On Tue, May 17, 2011 at 2:43 PM, Thomas Kappler <[EMAIL PROTECTED]> wrote:
>> Hi all,
>>
>> are there any tools that visualize the data flow in a Pig script, such
>> as the joins, unions etc.? Maybe somewhat like this:
>>
>> A   B
>>  \ /
>>  C
>>
>> I imagine that would be very helpful during development of more
>> complex scripts. It might be done with Graphviz or similar tools. I
>> couldn't find anything on ther web.
>>
>> Cheers,
>> Thomas
>>
>
>
>
> --
> Harsh J
>

"explain foo -dot" will dump out a dot file representing the dataflow for producing relation foo.

-----Original Message-----
From: "Thomas Kappler" <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: 5/17/2011 2:13 AM
Subject: Visualizing the data flow of a Pig script

Hi all,

are there any tools that visualize the data flow in a Pig script, such
as the joins, unions etc.? Maybe somewhat like this:

A   B
  \ /
  C

I imagine that would be very helpful during development of more
complex scripts. It might be done with Graphviz or similar tools. I
couldn't find anything on ther web.

Cheers,
Thomas