Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> Execution of udf


+
nagarjuna kanamarlapudi 2013-01-18, 12:59
+
Dean Wampler 2013-01-18, 14:54
No but the query execution shows a reducer running .. And infant I feel
that reduce phase can be there

On Friday, January 18, 2013, Dean Wampler wrote:

> There is no reduce phase needed in this query.
>
> On Fri, Jan 18, 2013 at 6:59 AM, nagarjuna kanamarlapudi <
> [EMAIL PROTECTED] <javascript:_e({}, 'cvml',
> '[EMAIL PROTECTED]');>> wrote:
>
>> Hi,
>>
>> Select col1,myudf(col2,col3) from table1;
>>
>>
>> In what phase if map reduce an udf is executed.
>>
>> In the very beginning, I assumed that hive will be joining two tables.,
>> getting the required columns and then applies udf on columns specified
>> I.e., essentially on reducer phase . But later on I realised that I was
>> wrong.
>>
>> Is there any specific parameter which suggests hive to call udf at
>> reducer phase rather than at Mapper phase.
>>
>>
>> Regards,
>> Nagarjuna
>>
>>
>> --
>> Sent from iPhone
>>
>
>
>
> --
> *Dean Wampler, Ph.D.*
> thinkbiganalytics.com
> +1-312-339-1330
>
>

--
Sent from iPhone
+
Dean Wampler 2013-01-18, 14:58
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB