Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> How pig jobs are converted to map reduce

Copy link to this message
Re: How pig jobs are converted to map reduce
you can also use explain command to see the MR plan for a pig query. for
details on explain command see -


On 11/22/11 9:50 AM, Jonathan Coveney wrote:
> This paper is a good starting point:
> http://www.vldb.org/pvldb/2/vldb09-1074.pdf
> 2011/11/22 paritosh sumrao<[EMAIL PROTECTED]>
>> Hi all
>> Pig Latin script we write is converted to number of map reduce jobs to be
>> executed by Hadoop.
>> So my assumption was that if we write number of lines in Pig Latin, it will
>> generate a equivalent Map reduce program as in Java. But while debugging
>> the source code, I could not find anything of that sort .
>> In what way jobs are submitted to Hadoop? I want to know how Pig
>> communicates with Hadoop framework and get the jobs done. i was unable to
>> find this thing. It will help me greatly in my college project.
>> Thanks and regards,
>> http://krazycoder.wordpress.com