Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Load data in (external table) from symbolic link


Copy link to this message
-
Load data in (external table) from symbolic link
Hi,

I am trying to create an external table in Hive by pointing it to a file
that has symbolic links in its path reference.

Hive seems to complain with the following error indicating that it thinks
the symbolic link is a file:

java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error:
Invalid argument (22)
     at com.mapr.fs.MapRClient.open(MapRClient.java:190)
     at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327)
     at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460)
     at
org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93)
     at
org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54)
     at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383)
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336)
     at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:396)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109)
     at org.apache.hadoop.mapred.Child.main(Child.java:264)

Any help would be appreciated.