Hello,

On https://issues.apache.org/jira/browse/PIG-200, one can find the scripts
to generate data. But the data seems generic, meaning no relation to the
pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix

There are three other patch files, containing a mixture of shell commands
and java code. One cant run these as is..

Is there someone in the community, who has a clean Hadoop env with pig and
checked the performance using pigmix and could publish the scripts to:
1. generate the data with the right parameters (file names, num of rows,
etc)
2. launch the pigmix scripts

Thanks,
Keren

--
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com

Hey Keren,

PIG-200 contains script meant precisely for PigMix queries. Can you be more
elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
page you pointed contains the performance numbers though dated.

Hope it helps,
Ashutosh

On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <[EMAIL PROTECTED]> wrote:

> Hello,
>
> On https://issues.apache.org/jira/browse/PIG-200, one can find the scripts
> to generate data. But the data seems generic, meaning no relation to the
> pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
>
> There are three other patch files, containing a mixture of shell commands
> and java code. One cant run these as is..
>
> Is there someone in the community, who has a clean Hadoop env with pig and
> checked the performance using pigmix and could publish the scripts to:
> 1. generate the data with the right parameters (file names, num of rows,
> etc)
> 2. launch the pigmix scripts
>
> Thanks,
> Keren
>
> --
> Keren Ouaknine
> Cell: +972 54 2565404
> Web: www.kereno.com
>

Hello Ashutosh,

The files on PIG-200 are:
- Generate_data.pl - generates pseudo-random data, no relation to scripts
1-17
- 4 patches files each containing a mixture of java code and shell
commands.
These are not ready-to-use scripts for running pigmix..

As for the results published, I cant use these as my purpose is to measure
pig's performance against:
- MR performance
- HPCC performance

Thus, I need to re-run the queries on my own cluster.

Thanks,
Keren

On Fri, Aug 26, 2011 at 5:18 AM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:

> Hey Keren,
>
> PIG-200 contains script meant precisely for PigMix queries. Can you be more
> elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
> page you pointed contains the performance numbers though dated.
>
> Hope it helps,
> Ashutosh
>
> On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <[EMAIL PROTECTED]> wrote:
>
> > Hello,
> >
> > On https://issues.apache.org/jira/browse/PIG-200, one can find the
> scripts
> > to generate data. But the data seems generic, meaning no relation to the
> > pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
> >
> > There are three other patch files, containing a mixture of shell commands
> > and java code. One cant run these as is..
> >
> > Is there someone in the community, who has a clean Hadoop env with pig
> and
> > checked the performance using pigmix and could publish the scripts to:
> > 1. generate the data with the right parameters (file names, num of rows,
> > etc)
> > 2. launch the pigmix scripts
> >
> > Thanks,
> > Keren
> >
> > --
> > Keren Ouaknine
> > Cell: +972 54 2565404
> > Web: www.kereno.com
> >
>

--
Keren Ouaknine
Cell: +972 54 2565404
Web: www.kereno.com

You only need to apply pigmix2.patch. Instruction is here:
https://issues.apache.org/jira/browse/PIG-200?focusedCommentId=12879256&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12879256

Daniel

On Thu, Aug 25, 2011 at 8:08 PM, Keren Ouaknine <[EMAIL PROTECTED]> wrote:
> Hello Ashutosh,
>
> The files on PIG-200 are:
> - Generate_data.pl - generates pseudo-random data, no relation to scripts
> 1-17
> - 4 patches files each containing a mixture of java code and shell
> commands.
> These are not ready-to-use scripts for running pigmix..
>
> As for the results published, I cant use these as my purpose is to measure
> pig's performance against:
> - MR performance
> - HPCC performance
>
> Thus, I need to re-run the queries on my own cluster.
>
> Thanks,
> Keren
>
> On Fri, Aug 26, 2011 at 5:18 AM, Ashutosh Chauhan <[EMAIL PROTECTED]>wrote:
>
>> Hey Keren,
>>
>> PIG-200 contains script meant precisely for PigMix queries. Can you be more
>> elaborate in why you are not able to use them. w.r.t numbers PigMix wiki
>> page you pointed contains the performance numbers though dated.
>>
>> Hope it helps,
>> Ashutosh
>>
>> On Thu, Aug 25, 2011 at 18:47, Keren Ouaknine <[EMAIL PROTECTED]> wrote:
>>
>> > Hello,
>> >
>> > On https://issues.apache.org/jira/browse/PIG-200, one can find the
>> scripts
>> > to generate data. But the data seems generic, meaning no relation to the
>> > pigmix scripts 1-17 published on http://wiki.apache.org/pig/PigMix
>> >
>> > There are three other patch files, containing a mixture of shell commands
>> > and java code. One cant run these as is..
>> >
>> > Is there someone in the community, who has a clean Hadoop env with pig
>> and
>> > checked the performance using pigmix and could publish the scripts to:
>> > 1. generate the data with the right parameters (file names, num of rows,
>> > etc)
>> > 2. launch the pigmix scripts
>> >
>> > Thanks,
>> > Keren
>> >
>> > --
>> > Keren Ouaknine
>> > Cell: +972 54 2565404
>> > Web: www.kereno.com
>> >
>>
>
>
>
> --
> Keren Ouaknine
> Cell: +972 54 2565404
> Web: www.kereno.com
>