search

zero-one-group / geni

A Clojure dataframe library that runs on Spark
Apache License 2.0
281 stars 28 forks source link

Support Spark NLP ? #323

Open behrica opened 3 years ago

behrica commented 3 years ago

There is a pre-release for Spark NLP on Spark 3.0.0

This might it possible to use it with Geni ?

https://github.com/JohnSnowLabs/spark-nlp/releases/tag/3.0.0-rc8

samrose commented 3 years ago

I am interested in this too.

anthony-khong commented 3 years ago

Hi @behrica! Thanks for the tip! Looks like it could be possible! Unfortunately I currently have the bandwidth to work on it :( Any sort of contributions here would be greatly appreciated!

samrose commented 3 years ago

@anthony-khong is getting a package/library like this one working with Geni usually a matter of mapping out/wrapping the scala interop?

anthony-khong commented 3 years ago

@samrose apologies, I just saw this comment. Yes, it's a matter of wrapping with a nice idiomatic layer, because usually interop code tends not to play nice with, say, the REPL.