Pig, mail # dev - PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

Julien Le Dem 2011-01-09, 23:15

However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

Richard Ding 2011-01-10, 22:41

What method did you call to check if a dataset is empty? It's known that the counters don't work in local mode.
On 1/9/11 3:15 PM, "Julien Le Dem" <[EMAIL PROTECTED]> wrote:

However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

Julien Le Dem 2011-01-10, 22:52

I was calling result("<alias>").getNumberRecords() from a script.
I¹ve tried several of the methods but they all returned empty lists:
getOutputLocations()
getOutputNames()

If this is a known issue, is there a JIRA open ?
This should work independently of the mode.

Julien

On 1/10/11 2:41 PM, "Richard Ding" <[EMAIL PROTECTED]> wrote:

> What method did you call to check if a dataset is empty? It¹s known that the
> counters don¹t work in local mode.
>
>
> On 1/9/11 3:15 PM, "Julien Le Dem" <[EMAIL PROTECTED]> wrote:
>
>> However, it works fine in mini cluster.
>> I'm not sure what causes it.
>> The consequence is that I can not check if a dataset is empty in the end
>> condition for the transitive closure in javascript.
>> Julien
>>
>>
>>
>

Re: PigStats returned by BoundScript.runSingle() does not contain any information in LOCAL mode

Richard Ding 2011-01-10, 23:07

The related jira is PIG-1286. We're waiting for a fix from hadoop team.

The methods getOutputLocations() and getOutputNames() don't use counters and they shouldn't return empty list.
On 1/10/11 2:52 PM, "Julien Le Dem" <[EMAIL PROTECTED]> wrote:

I was calling result("<alias>").getNumberRecords() from a script.
I've tried several of the methods but they all returned empty lists:
getOutputLocations()
getOutputNames()

If this is a known issue, is there a JIRA open ?
This should work independently of the mode.

Julien

On 1/10/11 2:41 PM, "Richard Ding" <[EMAIL PROTECTED]> wrote:

What method did you call to check if a dataset is empty? It's known that the counters don't work in local mode.
On 1/9/11 3:15 PM, "Julien Le Dem" <[EMAIL PROTECTED]> wrote:

However, it works fine in mini cluster.
I'm not sure what causes it.
The consequence is that I can not check if a dataset is empty in the end
condition for the transitive closure in javascript.
Julien