Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs


Copy link to this message
-
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3, java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs
Folk,
I am trying to bulk load the hdfs file into hbase with

LoadIncrementalHFiles loader = new LoadIncrementalHFiles(conf);

 loader.doBulkLoad(new Path(args[1]), hTable);
However, i receive exception of java.io.IOException: java.io.IOException:
No FileSystem for scheme: maprfs

Exception in thread "main" java.io.IOException: BulkLoad encountered an
unrecoverable problem

at
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.bulkLoadPhase(LoadIncrementalHFiles.java:331)

at
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.doBulkLoad(LoadIncrementalHFiles.java:261)

at com.walmartlabs.targeting.mapred.Driver.main(Driver.java:81)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:597)

at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
after attempts=10, exceptions:

Tue Jun 17 21:48:58 PDT 2014,
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles$3@482d59a3,
java.io.IOException: java.io.IOException: No FileSystem for scheme: maprfs
What is the reason for this exception? I did some googling, and tried to
add some config to Hbase configuration:

 hbaseConf.set("fs.hdfs.impl",

  org.apache.hadoop.hdfs.DistributedFileSystem.class.getName());

 hbaseConf.set("fs.file.impl",

  org.apache.hadoop.fs.LocalFileSystem.class.getName());
But it does not have any effect. Is this error indicating that I basically
need a hbase mapr client? currently my pom looks like this;

<dependency>

<groupId>org.apache.hadoop</groupId>

<artifactId>hadoop-client</artifactId>

<version>1.0.3</version>

</dependency>

<dependency>

<groupId>org.apache.hadoop</groupId>

<artifactId>hadoop-core</artifactId>

<version>1.2.1</version>

</dependency>

<dependency>

<groupId>org.apache.httpcomponents</groupId>

<artifactId>httpclient</artifactId>

<version>4.1.1</version>

</dependency>

<dependency>

<groupId>com.google.code.gson</groupId>

<artifactId>gson</artifactId>

<version>2.2.4</version>

</dependency>
<dependency>

<groupId>org.apache.hbase</groupId>

<artifactId>hbase</artifactId>

<version>0.94.6.1</version>

</dependency>

Any idea?

Thanks advance.

Chen

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB