Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - hive-0.10 and nullpointerexception


Copy link to this message
-
Re: hive-0.10 and nullpointerexception
Mark Grover 2013-02-13, 16:34
Hi Marcin,
Sorry to hear that you ran into this.

My guess is you are using Yarn and this is, in fact, a known issue.

The culprit line here is
https://github.com/apache/hive/blob/branch-0.10/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java#L209

This issue is being tracked by
https://issues.apache.org/jira/browse/HIVE-4003 which is assigned to me, I
will try to get this in sooner than later.

In the meanwhile, a workaround is to set yarn.resourcemanager.address
property to some value other than "local" so Hive queries can run on your
MR2 cluster.

Mark

On Wed, Feb 13, 2013 at 7:13 AM, Marcin Cylke <[EMAIL PROTECTED]> wrote:

> Hi
>
> I'm experiencing the following problem when running a simple query under
> hive-0.10. I'm using the stock release package with CDH-4.1
>
> The query need to execute map-reduce job for this to happen. For me
> something along this one is sufficient:
>
> select count(*) from sample_table;
>
> The error I get looks like this and is taken from TaskTracker logs.
>
> INFO org.apache.hadoop.mapred.TaskStatus: task-diagnostic-info for task
> attempt_201302111523_0285_m_000000_0 : java.lang.RuntimeException:
> java.lang.NullPointerException
>         at
> org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:226)
>         at
> org.apache.hadoop.hive.ql.io.HiveInputFormat.init(HiveInputFormat.java:255)
>         at
>
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:381)
>         at
>
> org.apache.hadoop.hive.ql.io.HiveInputFormat.pushProjectionsAndFilters(HiveInputFormat.java:374)
>         at
>
> org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getRecordReader(CombineHiveInputFormat.java:536)
>         at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:373)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:327)
>         at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at
>
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
>         at org.apache.hadoop.mapred.Child.main(Child.java:262)
> Caused by: java.lang.NullPointerException
>         at
> org.apache.hadoop.hive.ql.exec.Utilities.getMapRedWork(Utilities.java:211)
>         ... 11 more
>
>
> Is this a known issue? Should I report a Jira?
>
> Regards
> Marcin
>