Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
134 stars 67 forks source link

Add whitelist filter in file access event. #2200

Closed lipppppp closed 4 years ago

lipppppp commented 4 years ago

There is no whitelist check in the access event report process. If user read files which is not in the whitelist from hdfs layer, access event still be counted. So, I add a simple filter to solve this issue.

PHILO-HE commented 4 years ago

We have a check in SmartClient#shouldIgnore. It's better to do the check in client side to avoid put pressure on server side. Please do the modification in that piece of code, if you need.

lipppppp commented 4 years ago

Thanks for your suggestions. But when I read file using "hdfs dfs -cat /path" command, access event didn't be filtered. That's why I add the check on server side.