Support for Spark - Githubissues

scikit-learn-contrib / category_encoders

A library of sklearn compatible categorical variable encoders

http://contrib.scikit-learn.org/category_encoders/

BSD 3-Clause "New" or "Revised" License

2.41k stars 396 forks source link

Support for Spark #433

Closed ArijitSinghEDA closed 10 months ago

ArijitSinghEDA commented 10 months ago

I apologize for creating issue here, but I could not see any discussion section. Is this library usable with Spark?

PaulWestenthanner commented 10 months ago

There is no native spark support (i.e. algorithms reimplemented in spark). You should be able to use spark though if you broadcast the library to the executors