Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop >> mail # user >> Unable to load native hadoop library


Copy link to this message
-
Unable to load native hadoop library
Hi-
I'm just getting started with Sqoop and am running some tests against mySQL to get the hang of things.
Sqoop:  1.4.4
hadoop: tried both 1.2.1 and 2.2.0
platform: OS X

Unfortunately I am hitting the following error when trying to import. Appreciate any help!

-BC

==> sqoop import --connect jdbc:mysql://localhost/hadoopguide --table widgets -m 1

14/01/02 15:57:58 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/01/02 15:57:58 INFO tool.CodeGenTool: Beginning code generation
14/01/02 15:57:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
14/01/02 15:57:59 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `widgets` AS t LIMIT 1
14/01/02 15:57:59 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/local
Note: /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
14/01/02 15:58:00 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-bcobb/compile/d54504715f779b2aa610a608f51aa56b/widgets.jar
..
14/01/02 15:58:00 INFO mapreduce.ImportJobBase: Beginning import of widgets
2014-01-02 15:58:00.683 java[60905:1903] Unable to load realm info from SCDynamicStore
..
4/01/02 15:58:05 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
14/01/02 15:58:11 INFO mapred.JobClient: Cleaning up the staging area file:/tmp/hadoop-bcobb/mapred/staging/bcobb678313846/.staging/job_local678313846_0001
14/01/02 15:58:11 ERROR security.UserGroupInformation: PriviledgedActionException as:bcobb cause:java.net.UnknownHostException: bcobb-mbpr.local: bcobb-mbpr.local: nodename nor servname provided, or not known
14/01/02 15:58:11 ERROR tool.ImportTool: Encountered IOException running import job: java.net.UnknownHostException: bcobb-mbpr.local: bcobb-mbpr.local: nodename nor servname provided, or not known
at java.net.InetAddress.getLocalHost(InetAddress.java:1473)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:960)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:936)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1190)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:936)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:550)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:580)
at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:186)
at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:159)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:239)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:600)
at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:118)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:413)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:502)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229)
at org.apache.sqoop.Sqoop.main(Sqoop.java:238)
Caused by: java.net.UnknownHostException: bcobb-mbpr.local: nodename nor servname provided, or not known
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$1.lookupAllHostAddr(InetAddress.java:901)
at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1293)
at java.net.InetAddress.getLocalHost(InetAddress.java:1469)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB