Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> join string in hive udf


Copy link to this message
-
Re: join string in hive udf
Hi,

Check the hadoop logs of the failed task. My best guess is that there is an
uncaught exception thrown somewhere in your code. The logs will tell where
and what caused the problem.

Best regards,
Jan

On Tue, Jun 26, 2012 at 4:20 PM, Yue Guan <[EMAIL PROTECTED]> wrote:

> Hi, hive users
>
> I have the following udf:
>
> package com.name.hadoop.hive.udf;
>
> import java.util.Set;
>
> import org.apache.commons.lang.StringUtils;
>
> import org.apache.hadoop.hive.ql.exec.UDF;
> import org.apache.hadoop.io.Text;
>
>
> public class MyUDF extends UDF {
>
>    private Map<Long, Set<Long>> aMapping;
>    private final Text result = new Text();
>
>    public MyUDF() throws Exception {
>        aMapping = someModuleSamePackage.getMapping();
>    }
>
>    public Text evaluate(final Text o) throws Exception {
>        result.clear();
>
>        if (o != null) {
>            Long id = new Long(o.toString());
>            Set<Long> ids = aMapping.get(id);
>            if (ids != null) {
>                    String resultString = StringUtils.join(ids, ",");
>                    result.set(resultString);
>            }
>        }
>
>        return result;
>    }
> }
>
> However, I always get FAILED: Execution Error, return code 2 from
> org.apache.hadoop.hive.ql.exec.MapRedTask. Anyone suggests anything to
> work around this? Thank you in advance.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB