Closed MostAwesomeDude closed 9 months ago
Several thoughts:
DataSet
objects, along with SimilarityIndex
objects, LanguageModel
objects, and eventually RAGPipeline
objects. It's starting to sound like this data should be in a durable database which supports relational queries (SQL) instead of k8s.DataSetBroker
would do for us, exactly. As a side table for SQL, it makes plenty of sense; as a CRD, I don't know what I would do with most of those fields.
Standard distributed-system stuff.