|
|
-
Load data in (external table) from symbolic link
Hadoop Inquirer 2012-12-07, 23:17
Hi,
I am trying to create an external table in Hive by pointing it to a file that has symbolic links in its path reference.
Hive seems to complain with the following error indicating that it thinks the symbolic link is a file:
java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error: Invalid argument (22) at com.mapr.fs.MapRClient.open(MapRClient.java:190) at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460) at org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93) at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54) at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336) at org.apache.hadoop.mapred.Child$4.run(Child.java:270) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109) at org.apache.hadoop.mapred.Child.main(Child.java:264)
Any help would be appreciated.
+
Hadoop Inquirer 2012-12-07, 23:17
-
RE: Load data in (external table) from symbolic link
Vivek Mishra 2012-12-08, 12:38
Looks like "MapR" is complaining for mounted directory and somehow it is not accessible.
-Vivek ________________________________ From: Hadoop Inquirer [[EMAIL PROTECTED]] Sent: 08 December 2012 04:47 To: [EMAIL PROTECTED] Subject: Load data in (external table) from symbolic link
Hi,
I am trying to create an external table in Hive by pointing it to a file that has symbolic links in its path reference.
Hive seems to complain with the following error indicating that it thinks the symbolic link is a file:
java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error: Invalid argument (22) at com.mapr.fs.MapRClient.open(MapRClient.java:190) at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460) at org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93) at org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54) at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237) at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336) at org.apache.hadoop.mapred.Child$4.run(Child.java:270) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109) at org.apache.hadoop.mapred.Child.main(Child.java:264)
Any help would be appreciated. ________________________________ NOTE: This message may contain information that is confidential, proprietary, privileged or otherwise protected by law. The message is intended solely for the named addressee. If received in error, please destroy and notify the sender. Any use of this email is prohibited when received in error. Impetus does not represent, warrant and/or guarantee, that the integrity of this communication has been maintained nor that the communication is free of errors, virus, interception or interference.
+
Vivek Mishra 2012-12-08, 12:38
|
|
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by
Sematext