Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # dev - Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite


+
Curtis Strite 2012-10-15, 19:59
Copy link to this message
-
Re: [jira] [Commented] (PIG-2963) Illustrate command and POPackageLite
Alan Gates 2012-10-15, 20:29
Send email to [EMAIL PROTECTED]

Alan.

On Oct 15, 2012, at 12:59 PM, Curtis Strite wrote:

> How do I remove myself from this distro?
>
>
>
> Thanks,
> Curtis
>
>
>
> On Mon, Oct 15, 2012 at 2:57 PM, Jonathan Coveney (JIRA) <[EMAIL PROTECTED]>wrote:
>
>>
>>    [
>> https://issues.apache.org/jira/browse/PIG-2963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13476372#comment-13476372]
>>
>> Jonathan Coveney commented on PIG-2963:
>> ---------------------------------------
>>
>> Allan: it comes down to pestering a committer to reviewing and committing,
>> or just hoping they look at it.
>>
>> Which I just did. Thanks for the fix, Cheolsoo. It's in!
>>
>>> Illustrate command and POPackageLite
>>> ------------------------------------
>>>
>>>                Key: PIG-2963
>>>                URL: https://issues.apache.org/jira/browse/PIG-2963
>>>            Project: Pig
>>>         Issue Type: Bug
>>>           Reporter: Allan AvendaƱo
>>>           Assignee: Cheolsoo Park
>>>           Priority: Critical
>>>            Fix For: 0.11
>>>
>>>        Attachments: PIG-2963.patch
>>>
>>>
>>> While trying to execute a simple script like:
>>> A = LOAD 'test01' AS (f1:chararray,f2:int,f3:chararray);
>>> B = order A by f1;
>>> illustrate B;
>>> or
>>> C = foreach B generate f1, f2;
>>> illustrate C;
>>> I got the following exception:
>>> java.lang.RuntimeException: ReadOnceBag does not support getMemorySize
>> operation
>>>      at
>> org.apache.pig.data.ReadOnceBag.getMemorySize(ReadOnceBag.java:74)
>>>      at org.apache.pig.data.SizeUtil.getPigObjMemSize(SizeUtil.java:61)
>>>      at
>> org.apache.pig.data.DefaultTuple.getMemorySize(DefaultTuple.java:180)
>>>      at
>> org.apache.pig.pen.util.ExampleTuple.getMemorySize(ExampleTuple.java:97)
>>>      at
>> org.apache.pig.data.DefaultAbstractBag.getMemorySize(DefaultAbstractBag.java:148)
>>>      at
>> org.apache.pig.data.DefaultAbstractBag.markSpillableIfNecessary(DefaultAbstractBag.java:100)
>>>      at
>> org.apache.pig.data.DefaultAbstractBag.add(DefaultAbstractBag.java:92)
>>>      at org.apache.pig.pen.Illustrator.addData(Illustrator.java:116)
>>>      at
>> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.illustratorMarkup(POPackageLite.java:227)
>>>      at
>> org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POPackageLite.getNext(POPackageLite.java:182)
>>>      at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.processOnePackageOutput(PigGenericMapReduce.java:422)
>>>      at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:413)
>>>      at
>> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigGenericMapReduce$Reduce.reduce(PigGenericMapReduce.java:257)
>>>      at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
>>>      at
>> org.apache.pig.pen.LocalMapReduceSimulator.launchPig(LocalMapReduceSimulator.java:235)
>>>      at
>> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:257)
>>>      at
>> org.apache.pig.pen.ExampleGenerator.getData(ExampleGenerator.java:238)
>>>      at
>> org.apache.pig.pen.LineageTrimmingVisitor.init(LineageTrimmingVisitor.java:103)
>>>      at
>> org.apache.pig.pen.LineageTrimmingVisitor.<init>(LineageTrimmingVisitor.java:98)
>>>      at
>> org.apache.pig.pen.ExampleGenerator.getExamples(ExampleGenerator.java:166)
>>>      at org.apache.pig.PigServer.getExamples(PigServer.java:1180)
>>>      at
>> org.apache.pig.tools.grunt.GruntParser.processIllustrate(GruntParser.java:738)
>>>      at
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.Illustrate(PigScriptParser.java:626)
>>>      at
>> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:323)
>>>      at
>> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:193)