search

RumbleDB / rumble

⛈️ RumbleDB 1.22.0 "Pyrenean oak" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
http://rumbledb.org/
Other
213 stars 82 forks source link

Modules #6

Closed ghislainfourny closed 4 years ago

ghislainfourny commented 6 years ago

Support library modules

DanGraur commented 4 years ago

I would tend to agree that the addition of modules could prove to have a strong positive impact in the long run. I'm currently writing up the CERN ADL Benchmarks in JSONiq over Rumble+Spark, and I often have to copy-paste function code from one query script to another. This makes the query scripts more cluttered, and, in turn, it gives the initial false impression that the queries are more complex than they really are. Moreover, if one function (on which multiple queries depend) changes, then one needs to manually go through all the query scripts and apply the same change repeatedly. This implies greater programmer effort, and can even lead to higher chances of coding errors.

ghislainfourny commented 4 years ago

@DanGraur this is done and will be officially released in the coming days. Thanks for your feedback!