Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> set HTTPFS in Hadoop 2.0.4


Copy link to this message
-
set HTTPFS in Hadoop 2.0.4
Hi,

I set the HTTFS of Hadoop 2.0.4 to run in the port 3888. Now I want to
access the filesystem but I can't do it. Here's the URL that I am using,
and the config files. How can I fix this?

http://host:3888/webhdfs/v1/user/myuser?user.name=myuser&op=list

{"RemoteException":{"message":"java.lang.IllegalArgumentException:
No enum const class
org.apache.hadoop.fs.http.client.HttpFSFileSystem$Operation.LIST",
"exception":"QueryParamException","javaClassName":
"com.sun.jersey.api.ParamException$QueryParamException"}}

$ netstat -plnet
Proto Recv-Q Send-Q Local Address               Foreign Address
State       User       Inode      PID/Program name
tcp        0      0 0.0.0.0:3888                0.0.0.0:*
LISTEN      78250      109481130  1580/java        <<<< HTTPFS server is
running

$ cat etc/hadoop/httpfs-env.sh
#!/bin/bash
# Set httpfs specific environment variables here.

# Settings for the Embedded Tomcat that runs HttpFS
# Java System properties for HttpFS should be specified in this variable
# export CATALINA_OPTS
# HttpFS logs directory
# export HTTPFS_LOG=${HTTPFS_HOME}/logs

# HttpFS temporary directory
# export HTTPFS_TEMP=${HTTPFS_HOME}/temp

# The HTTP port used by HttpFS
export HTTPFS_HTTP_PORT=3888

# The Admin port used by HttpFS
# export HTTPFS_ADMIN_PORT=`expr ${HTTPFS_HTTP_PORT} + 1`

# The hostname HttpFS server runs on
export HTTPFS_HTTP_HOSTNAME=`hostname -f`
$ cat etc/hadoop/httpfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<configuration>
 <property>
   <name>httpfs.proxyuser.myuser.hosts</name>
   <value>*</value>
 </property>
 <property>
   <name>httpfs.proxyuser.myuser.groups</name>
   <value>*</value>
 </property>
 <property>
   <name>httpfs.authentication.type</name>
   <value>simple</value>
 </property>
--
Best regards,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB