Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> Deprecate hftp / hsftp

Copy link to this message
Deprecate hftp / hsftp

Recently I've been focusing on fixing hftp / hsftp / webhdfs / swebhdfs in
various set ups. Now we have reached the state that all the above file
systems can work in both secure and insecure clusters, and transfer data
through both http and https.

Taking a step back, these file systems are very similar, and I'm wondering
whether it is a good time to deprecate hftp and hsftp in Hadoop right now.

The main reason is that hftp / hsftp only provides a strict subset of
functionalities that webhdfs / swebhdfs offer. Notably, webhdfs / swebhdfs
support writes and HA which hftp / hsftp do not support. It's more natural
to move forward with webhdfs / swebhdfs, keeping both hftp / hsftp around
seems introducing more work.

Another reason is that webhdfs has been supported since Hadoop 1, thus
getting rid of hftp / hsftp does not seem removing any features, even the
users are trying to migrate from Hadoop 1 to Hadoop 2.
Your ideas are appreciated.


NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Suresh Srinivas 2013-11-26, 21:40
lohit 2013-11-26, 21:51
Haohui Mai 2013-11-26, 22:19
Haohui Mai 2013-11-26, 22:29
Tsz Wo \ 2013-11-27, 01:33
Jing Zhao 2013-11-27, 02:01
Adam Faris 2013-11-26, 22:06
Haohui Mai 2013-11-26, 22:25
Eli Collins 2013-11-26, 21:31
Haohui Mai 2014-03-27, 18:28