search

Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
133 stars 67 forks source link

Support HDFS federation ？ #2235

Closed zy-jordan closed 3 years ago

zy-jordan commented 3 years ago

Does SSM support hdfs federation？

PHILO-HE commented 3 years ago

By far, no test has been done on HDFS federation. You can consider to have a try. I guess there may exist some issues in supporting HDFS federation.

zy-jordan commented 3 years ago

If support hdfs federation, metastore may change. because the file table don't have namespace column.

PHILO-HE commented 3 years ago

Yes, file table doesn't maintain namespaces in current implementation. We will not develop new feature for this open source project. My suggestion is you can deploy a POC environment to test SSM for non-federation case. If this project really meets your goal, you can consider to develop this project to support federation case.

PHILO-HE commented 3 years ago

Please re-open this issue if more discussion is required.