Support for Spark - Githubissues

scikit-learn-contrib / category_encoders

A library of sklearn compatible categorical variable encoders

http://contrib.scikit-learn.org/category_encoders/

BSD 3-Clause "New" or "Revised" License

2.39k stars 393 forks source link

Support for Spark #433

Closed ArijitSinghEDA closed 6 months ago

ArijitSinghEDA commented 6 months ago

I apologize for creating issue here, but I could not see any discussion section. Is this library usable with Spark?

PaulWestenthanner commented 6 months ago

There is no native spark support (i.e. algorithms reimplemented in spark). You should be able to use spark though if you broadcast the library to the executors