[cosmos-sequence-api] Create - Githubissues

telefonicaid / fiware-cosmos

fiware-cosmos toolkit for administration and support. Includes Sahara plugin

GNU Affero General Public License v3.0

11 stars 15 forks source link

[cosmos-sequence-api] Create #176

Open frbattid opened 8 years ago

frbattid commented 8 years ago

It seems WebHDFS, the official REST API for doing HDFS I/O does not support Hadoop sequence files, a special binary data format.

Thus, it would be nice to create a REST API similar to WebHDFS supporting sequence files. Even, this API could "extend" the original WebHDFS:

Operations such as "open" or "append" must include a header or parameter describing if the payload contains sequence or text data.
Text data related operations would be forwarded to the original WebHDFS API.
Sequence data related operations would be managed by our API, using the Hadoop Java API about sequence files.

Additional useful links:

http://hadooptutorial.info/hadoop-sequence-files-example/