Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - how to get the mapreduce code which was pig/hive script translated to?


Copy link to this message
-
Re: how to get the mapreduce code which was pig/hive script translated to?
Marcos Luis Ortiz Valmase... 2013-06-16, 16:28
Edward is right. With log4j, you can see that. Here, you have the example:
https://github.com/apache/hadoop-common/blob/HADOOP-3628/conf/log4j.properties

The relevant info in the docs:
http://hadoop.apache.org/docs/stable/cluster_setup.html#Logging

Some working examples:
http://stackoverflow.com/questions/8975609/setting-the-logging-level-in-hadoop-to-warn
http://stackoverflow.com/questions/7801610/how-to-suppress-hadoop-logging-message-on-the-console?rq=1

2013/6/16 Edward Capriolo <[EMAIL PROTECTED]>

> Hive serializes the entire plan into an XML file if you set the log 4j
> settings to debug you should get the locations to the files itgenerates
> before launching the job.
>
>
> On Sun, Jun 16, 2013 at 11:08 AM, Harsh J <[EMAIL PROTECTED]> wrote:
>
>> This is a question for the Hive/Pig lists to answer best.
>>
>> Note though that they only compile a plan, not the code. The code is
>> available already, the compiled plan just structures the execution
>> flow. If you take a look at the sources, you'll find the bits and
>> pieces that get linked together depending on the operation.
>>
>> On Sun, Jun 16, 2013 at 10:15 AM, 王洪军 <[EMAIL PROTECTED]> wrote:
>> > hi,all
>> >
>> >      how to get the mapreduce code which was pig/hive script translated
>> to?
>> >
>> > Best regards,
>> > wanghj
>> >
>>
>>
>>
>> --
>> Harsh J
>>
>
>
--
Marcos Ortiz Valmaseda
Product Manager at PDVSA
http://about.me/marcosortiz