Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Load data in (external table) from symbolic link


Copy link to this message
-
Load data in (external table) from symbolic link
Hi,

I am trying to create an external table in Hive by pointing it to a file
that has symbolic links in its path reference.

Hive seems to complain with the following error indicating that it thinks
the symbolic link is a file:

java.io.IOException: Open failed for file: /dir1/dir2/dir3_symlink, error:
Invalid argument (22)
     at com.mapr.fs.MapRClient.open(MapRClient.java:190)
     at com.mapr.fs.MapRFileSystem.open(MapRFileSystem.java:327)
     at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:460)
     at
org.apache.hadoop.mapred.LineRecordReader.<init>(LineRecordReader.java:93)
     at
org.apache.hadoop.mapred.TextInputFormat.getRecordReader(TextInputFormat.java:54)
     at
org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:237)
     at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:383)
     at org.apache.hadoop.mapred.MapTask.run(MapTask.java:336)
     at org.apache.hadoop.mapred.Child$4.run(Child.java:270)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:396)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1109)
     at org.apache.hadoop.mapred.Child.main(Child.java:264)

Any help would be appreciated.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB