Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> How pig jobs are converted to map reduce


Copy link to this message
-
Re: How pig jobs are converted to map reduce
you can also use explain command to see the MR plan for a pig query. for
details on explain command see -
http://ofps.oreilly.com/titles/9781449302641/developing_and_testing.html

-Thejas

On 11/22/11 9:50 AM, Jonathan Coveney wrote:
> This paper is a good starting point:
> http://www.vldb.org/pvldb/2/vldb09-1074.pdf
>
> 2011/11/22 paritosh sumrao<[EMAIL PROTECTED]>
>
>> Hi all
>>
>> Pig Latin script we write is converted to number of map reduce jobs to be
>> executed by Hadoop.
>> So my assumption was that if we write number of lines in Pig Latin, it will
>> generate a equivalent Map reduce program as in Java. But while debugging
>> the source code, I could not find anything of that sort .
>> In what way jobs are submitted to Hadoop? I want to know how Pig
>> communicates with Hadoop framework and get the jobs done. i was unable to
>> find this thing. It will help me greatly in my college project.
>>
>> Thanks and regards,
>>
>> http://krazycoder.wordpress.com
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB