uncharted-distil / distil-auto-ml

Distil Automated Machine Learning Server
Apache License 2.0
2 stars 1 forks source link

Multiple input datasets #259

Closed phorne-uncharted closed 3 years ago

phorne-uncharted commented 3 years ago

Fully specified pipelines can have multiple input datasets (ex: image retrieval). The code was only handling a single dataset uri. Changes were made to pass around arrays of uris. They get encoded into a csv when storing to the database for simplicity.

The search request was not updated much because right now we only needed fully specified pipelines updated. The dataset cache was also not updated to handle multiple datasets for short term simplicity.