Hi all

Pig Latin script we write is converted to number of map reduce jobs to be
executed by Hadoop.
So my assumption was that if we write number of lines in Pig Latin, it will
generate a equivalent Map reduce program as in Java. But while debugging
the source code, I could not find anything of that sort .
In what way jobs are submitted to Hadoop? I want to know how Pig
communicates with Hadoop framework and get the jobs done. i was unable to
find this thing. It will help me greatly in my college project.

Thanks and regards,

http://krazycoder.wordpress.com

This paper is a good starting point:
http://www.vldb.org/pvldb/2/vldb09-1074.pdf

2011/11/22 paritosh sumrao <[EMAIL PROTECTED]>

> Hi all
>
> Pig Latin script we write is converted to number of map reduce jobs to be
> executed by Hadoop.
> So my assumption was that if we write number of lines in Pig Latin, it will
> generate a equivalent Map reduce program as in Java. But while debugging
> the source code, I could not find anything of that sort .
> In what way jobs are submitted to Hadoop? I want to know how Pig
> communicates with Hadoop framework and get the jobs done. i was unable to
> find this thing. It will help me greatly in my college project.
>
> Thanks and regards,
>
> http://krazycoder.wordpress.com
>

you can also use explain command to see the MR plan for a pig query. for
details on explain command see -
http://ofps.oreilly.com/titles/9781449302641/developing_and_testing.html

-Thejas

On 11/22/11 9:50 AM, Jonathan Coveney wrote:
> This paper is a good starting point:
> http://www.vldb.org/pvldb/2/vldb09-1074.pdf
>
> 2011/11/22 paritosh sumrao<[EMAIL PROTECTED]>
>
>> Hi all
>>
>> Pig Latin script we write is converted to number of map reduce jobs to be
>> executed by Hadoop.
>> So my assumption was that if we write number of lines in Pig Latin, it will
>> generate a equivalent Map reduce program as in Java. But while debugging
>> the source code, I could not find anything of that sort .
>> In what way jobs are submitted to Hadoop? I want to know how Pig
>> communicates with Hadoop framework and get the jobs done. i was unable to
>> find this thing. It will help me greatly in my college project.
>>
>> Thanks and regards,
>>
>> http://krazycoder.wordpress.com
>>
>