teragrep / pth_10

Data Processing Language (DPL) translator for Apache Spark
GNU Affero General Public License v3.0
0 stars 2 forks source link

Imput regex pattern for bloomfilter operations in DPL #264

Open elliVM opened 2 months ago

elliVM commented 2 months ago

Description Currently the pattern for bloomfilter create and update is set inside spark.config, it would be better for user experience to imput it inside the dpl.

Use case or motivation behind the feature request Simplify the setup for bloomfilter operations and allow different patterns without interpreter restart that is needed to change spark.config a job is run.

Related issues

Additional context Feature for later when pattern acceleration is implemented