Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user - ipc.RemoteException in Hive


+
Павел Мезенцев 2012-07-17, 14:24
+
kulkarni.swarnim@...) 2012-07-17, 14:56
Copy link to this message
-
Re: ipc.RemoteException in Hive
Павел Мезенцев 2012-07-17, 15:17
We don't change anything in hive configuration.
And several days ago all was working fine.
Today this strange exception has appeared.
How we can find root of the problem and solve it?

Pavel

2012/7/17 [EMAIL PROTECTED] <[EMAIL PROTECTED]>

> "select *" queries don't really run a M/R job. Rather directly hit HDFS to
> grab the results. While "select count(*)" run mappers/reducers to perform
> the count on the data. The former running and the latter not suspects
> something might be wrong with your hadoop installation. Looking at the
> stacktrace, it even seems like the user executing this query might not have
> proper access.
>
> Are you able to run simple M/R jobs with the installation? You might also
> want to check on permissions.
>
> On Tue, Jul 17, 2012 at 9:24 AM, Павел Мезенцев <[EMAIL PROTECTED]>wrote:
>
>> Hello all!
>>
>> We have a trouble with hive.
>> My colleague created table "as_test" in hive
>> create external table as_test (line STRING) location '/logs/2012-07-16'
>>
>> Query
>> select * from as_test limit 10;
>> compliting successfully
>>
>> but query
>> select count (1) from as_test limit 10;
>> raise org.apache.hadoop.ipc.RemoteException.
>> How we can fix it?
>>
>> Best regards,
>> Pavel
>>
>> P.S. full stack trace:
>>
>> org.apache.hadoop.ipc.RemoteException: IPC server unable to read call
>> parameters : readObject can't find class
>> org.apache.hadoop.fs.permission.FsPermission$2
>>
>>         at org.apache.hadoop.ipc.Client.call(Client.java:1107)
>>
>>         at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:226)
>>
>>         at $Proxy4.setPermission(Unknown Source)
>>
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.
>> java:39)
>>
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>
>>         at java.lang.reflect.Method.invoke(Method.java:597)
>>
>>         at
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
>>
>>         at
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
>>
>>         at $Proxy4.setPermission(Unknown Source)
>>
>>         at
>> org.apache.hadoop.hdfs.DFSClient.setPermission(DFSClient.java:855)
>>
>>         at
>> org.apache.hadoop.hdfs.DistributedFileSystem.setPermission(DistributedFileSystem.java:560)
>>
>>         at
>> org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:123)
>>
>>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:839)
>>
>>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:833)
>>
>>         at java.security.AccessController.doPrivileged(Native Method)
>>
>>         at javax.security.auth.Subject.doAs(Subject.java:396)
>>
>>         at
>> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1127)
>>
>>         at
>> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:833)
>>
>>         at
>> org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:807)
>>
>>         at
>> org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:657)
>>
>>         at
>> org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:123)
>>
>>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:130)
>>
>>         at
>> org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>
>>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1063)
>>
>>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:900)
>>
>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:748)
>>
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:164)
>>
>>         at
>> org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:241)
>>
>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:456)