Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> how to get the mapreduce code which was pig/hive script translated to?


Copy link to this message
-
Re: how to get the mapreduce code which was pig/hive script translated to?
Edward is right. With log4j, you can see that. Here, you have the example:
https://github.com/apache/hadoop-common/blob/HADOOP-3628/conf/log4j.properties

The relevant info in the docs:
http://hadoop.apache.org/docs/stable/cluster_setup.html#Logging

Some working examples:
http://stackoverflow.com/questions/8975609/setting-the-logging-level-in-hadoop-to-warn
http://stackoverflow.com/questions/7801610/how-to-suppress-hadoop-logging-message-on-the-console?rq=1

2013/6/16 Edward Capriolo <[EMAIL PROTECTED]>

> Hive serializes the entire plan into an XML file if you set the log 4j
> settings to debug you should get the locations to the files itgenerates
> before launching the job.
>
>
> On Sun, Jun 16, 2013 at 11:08 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>
>> This is a question for the Hive/Pig lists to answer best.
>>
>> Note though that they only compile a plan, not the code. The code is
>> available already, the compiled plan just structures the execution
>> flow. If you take a look at the sources, you'll find the bits and
>> pieces that get linked together depending on the operation.
>>
>> On Sun, Jun 16, 2013 at 10:15 AM, 王洪军 <[EMAIL PROTECTED]> wrote:
>> > hi,all
>> >
>> >      how to get the mapreduce code which was pig/hive script translated
>> to?
>> >
>> > Best regards,
>> > wanghj
>> >
>>
>>
>>
>> --
>> Harsh J
>>
>
>
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB