Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Pig Illustrate more verbose, remove Ellipsis


Copy link to this message
-
Re: Pig Illustrate more verbose, remove Ellipsis
Hi Johnny,

Yes, with ILLUSTRATE I am expecting a small sample of the data to be
returned for each LHS statement in my Pig script. ILLUSTRATE renders out
the data in fields, regardless of the quantity of fields, but concatenates
them into ellipsis for larger, more complex nested data structures.  I can
trace back up the output and manually substitute in what the data should
look like, but I was hoping for a easier flag or bootstrap for ILLUSTRATE
to print out the full complex data Object to the terminal.

USE CASE:
Illustrate of some sample data; ILLUSTRATE print output of lines A, and B,
and desired response B (verbose):

A:                aaaa, bbbb, cccc, dddd, eeee, ffff, gggg, 1.0, 2.0, 3.0
B:                {(aaaa, *...,* {(bbbb,* ...,* 3.0)})}
B (verbose):  {(aaaa, cccc, dddd, {(bbbb, eeee, ffff, gggg, 1.0, 2.0,
3.0)})}
Thanks.

-Dan
On Tue, Apr 9, 2013 at 1:42 PM, Johnny Zhang <[EMAIL PROTECTED]> wrote:

> Hi, Dan:
> I guess this doesn't help you :) I don't think you can do that since
> ILLUSTRATE is based on sample data of your whole data set. To make the
> print out make sense, ILLUSTRATE also fake some data (not from the sample
> data) sometimes.
>
> Johnny
>
>
>
> On Tue, Apr 9, 2013 at 8:14 AM, Dan DeCapria, CivicScience <
> [EMAIL PROTECTED]> wrote:
>
> > Is there an easy way to non-truncate ILLUSTRATE and make each statement
> > more verbose for large nested complex Objects (aka, force removal of the
> > ellipsis from ILLUSTRATE and show all data)?
> >
> > Many Thanks.
> >
> > -Dan
> >
>

--
Dan DeCapria
CivicScience, Inc.
Senior Informatics / DM / ML / BI Specialist