Kimahriman / hdfs-native

Apache License 2.0
32 stars 12 forks source link

Support for `hdfs:///` #134

Closed santosh-d3vpl3x closed 1 month ago

santosh-d3vpl3x commented 4 months ago

hdfs:/// is a valid way of specifying hdfs URL. Especially when fs.defaultFS is set. The current implementation, however, doesn't really allow that and we get URL must contain a host.

Kimahriman commented 4 months ago

Hmm didn't know that was a thing. What happens if you specify hdfs:/// but your fs.defaultFS is viewfs://myfs?

santosh-d3vpl3x commented 4 months ago

Haven't encountered the situation but technically it should not work unless you have ViewFsOverloadScheme configured to hdfs.