superduper-io / superduper

Superduper: Integrate AI models and machine learning workflows with your database to implement custom AI applications, without moving your data. Including streaming inference, scalable model hosting, training and vector search.
https://superduper.io
Apache License 2.0
4.71k stars 460 forks source link

Migrate plugins #2378

Closed jieguangzhou closed 2 months ago

jieguangzhou commented 2 months ago

Description

Related Issues

Checklist

Additional Notes or Comments

jieguangzhou commented 2 months ago

What shall we do with "core" plugins/ extensions, for example ext/numpy? Shouldn't we move this somehow? Also, what is the plan for moving away from the superduper.ext.* sub-packages? Shall we raise a warning which can become an error later?

We need to retain some core plugins, which are pre-set, and can continue to use this ext until a better name is found.

I added the warning, and I think we can directly remove those plugins in the next one or two versions, at which point an import error will be thrown.