search

USCDataScience / sparkler

Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
http://irds.usc.edu/sparkler/
Apache License 2.0
410 stars 143 forks source link

Improve plugins #197

Open buggtb opened 3 years ago

buggtb commented 3 years ago

Can we make the plugin engine scriptable?

Being able to choose from different languages, Java, Go, Python etc would make the backend plugin engine so much more flexible.