Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - ipc.RemoteException in Hive


Copy link to this message
-
Re: ipc.RemoteException in Hive
kulkarni.swarnim@...) 2012-07-17, 14:56
"select *" queries don't really run a M/R job. Rather directly hit HDFS to
grab the results. While "select count(*)" run mappers/reducers to perform
the count on the data. The former running and the latter not suspects
something might be wrong with your hadoop installation. Looking at the
stacktrace, it even seems like the user executing this query might not have
proper access.

Are you able to run simple M/R jobs with the installation? You might also
want to check on permissions.

On Tue, Jul 17, 2012 at 9:24 AM, Павел Мезенцев <[EMAIL PROTECTED]> wrote:

> Hello all!
>
> We have a trouble with hive.
> My colleague created table "as_test" in hive
> create external table as_test (line STRING) location '/logs/2012-07-16'
>
> Query
> select * from as_test limit 10;
> compliting successfully
>
> but query
> select count (1) from as_test limit 10;
> raise org.apache.hadoop.ipc.RemoteException.
> How we can fix it?
>
> Best regards,
> Pavel
>
> P.S. full stack trace:
>
> org.apache.hadoop.ipc.RemoteException: IPC server unable to read call
> parameters : readObject can't find class
> org.apache.hadoop.fs.permission.FsPermission$2
>
>         at org.apache.hadoop.ipc.Client.call(Client.java:1107)
>
>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
>
>         at $Proxy4.setPermission(Unknown Source)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
> java:39)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>
>         at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>
>         at $Proxy4.setPermission(Unknown Source)
>
>         at
> org.apache.hadoop.hdfs.DFSClient.setPermission(DFSClient.java:855)
>
>         at
> org.apache.hadoop.hdfs.DistributedFileSystem.setPermission(DistributedFileSystem.java:560)
>
>         at
> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:123)
>
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)
>
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>
>         at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
>
>         at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
>
>         at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)
>
>         at
> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:657)
>
>         at
> org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
>
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
>
>         at
> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>
>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
>
>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
>
>         at
> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
>
>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)
>
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>
>         at java.lang.reflect.Method.invoke(Method.java:597)
>
>         at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
Swarnim