Cloudera has created a set of tools named Hoop allowing access through HTTP/S to HDFS. My first question was why would you use HTTP to access HDFS? Here is the answer:
- Transfer data between clusters running different versions of Hadoop (thereby overcoming RPC versioning issues).
- Access data in a HDFS cluster behind a firewall. The Hoop server acts as a gateway and is the only system that is allowed to go through the firewall.
Not sure though how many will use HTTP for transfering large amounts of data. But if you want to see how it is implemented, you can find the source code on GitHub.
Original title and link: Hoop - Hadoop HDFS Over HTTP ( ©myNoSQL)