Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
133 stars 67 forks source link

Directly use SmartInputStreamFactory to create DFSInputStream #2186

Closed PHILO-HE closed 4 years ago

PHILO-HE commented 4 years ago

Previously without decompression feature, we can firstly use DFS's own api to get inputstream and return it to application if the file length is not zero. And if the file length is zero, we ask SmartInputStreamFactory to create the inputstream. Since we can speculate that the file is compacted by SSM (the original file will be truncated to zero after the compaction). But after SSM compression is introduced, this speculation is useless. Because the compressed file is not zero at all.