search

yaooqinn / spark-ranger

已经合入(apache/incubator-kyuubi) ACL Management for Apache Spark SQL with Apache Ranger.
https://yaooqinn.github.io/spark-ranger/
Apache License 2.0
54 stars 56 forks source link

sparkPlugin init too many times #14

Closed brucemen711 closed 4 years ago

brucemen711 commented 4 years ago

Hi @yaooqinn ,

I see sparkPlugin init so many times on class RangerSparkMaskingExtension and RangerSparkRowFilterExtension. is any reason for that ? Can we make sparkPlugin static ?

yaooqinn commented 4 years ago

Do you mean the current implementation will not reuse the sparkPlugin？

brucemen711 commented 4 years ago

T try using query(select), RangerSparkRowFilterExtension always invoke so sparkPlugin is inited everytime query happen.

yaooqinn commented 4 years ago

As this project is moved to Apache Submarine as a submodule, I'll make a pr to resolve this there.

brucemen711 commented 4 years ago

Ok, thanks for your info.

brucemen711 commented 4 years ago

I will close it now, thanks you.