🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.
Currently, if a user creates his own custom Component:
class MyComponent(Component):
...
then, this code needs to be accessible in the installation of all environments using MyComponent.
It would be good to remove this requirement. For instance, the source code code be serialized in the db.metadata,
along with the parameters.
Possible solution
Serialize class with dill
Serialize the __repr__ of the class, to give users something to see
Add this serialization to metadata store with _BaseEncodable and base64 encoding
Reload the class definition to an in-memory module
Currently, if a user creates his own custom
Component
:then, this code needs to be accessible in the installation of all environments using
MyComponent
. It would be good to remove this requirement. For instance, the source code code be serialized in thedb.metadata
, along with the parameters.Possible solution
dill
__repr__
of the class, to give users something to see_BaseEncodable
andbase64
encoding