Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - set HTTPFS in Hadoop 2.0.4


Copy link to this message
-
set HTTPFS in Hadoop 2.0.4
Pedro Sá da Costa 2013-06-02, 12:56
Hi,

I set the HTTFS of Hadoop 2.0.4 to run in the port 3888. Now I want to
access the filesystem but I can't do it. Here's the URL that I am using,
and the config files. How can I fix this?

http://host:3888/webhdfs/v1/user/myuser?user.name=myuser&op=list

{"RemoteException":{"message":"java.lang.IllegalArgumentException:
No enum const class
org.apache.hadoop.fs.http.client.HttpFSFileSystem$Operation.LIST",
"exception":"QueryParamException","javaClassName":
"com.sun.jersey.api.ParamException$QueryParamException"}}

$ netstat -plnet
Proto Recv-Q Send-Q Local Address               Foreign Address
State       User       Inode      PID/Program name
tcp        0      0 0.0.0.0:3888                0.0.0.0:*
LISTEN      78250      109481130  1580/java        <<<< HTTPFS server is
running

$ cat etc/hadoop/httpfs-env.sh
#!/bin/bash
# Set httpfs specific environment variables here.

# Settings for the Embedded Tomcat that runs HttpFS
# Java System properties for HttpFS should be specified in this variable
# export CATALINA_OPTS
# HttpFS logs directory
# export HTTPFS_LOG=${HTTPFS_HOME}/logs

# HttpFS temporary directory
# export HTTPFS_TEMP=${HTTPFS_HOME}/temp

# The HTTP port used by HttpFS
export HTTPFS_HTTP_PORT=3888

# The Admin port used by HttpFS
# export HTTPFS_ADMIN_PORT=`expr ${HTTPFS_HTTP_PORT} + 1`

# The hostname HttpFS server runs on
export HTTPFS_HTTP_HOSTNAME=`hostname -f`
$ cat etc/hadoop/httpfs-site.xml
<?xml version="1.0" encoding="UTF-8"?>
<configuration>
 <property>
   <name>httpfs.proxyuser.myuser.hosts</name>
   <value>*</value>
 </property>
 <property>
   <name>httpfs.proxyuser.myuser.groups</name>
   <value>*</value>
 </property>
 <property>
   <name>httpfs.authentication.type</name>
   <value>simple</value>
 </property>
--
Best regards,