search

autowarefoundation / modelzoo

A collection of machine-learned models for use in autonomous driving applications.
https://www.autoware.org/
Apache License 2.0
62 stars 24 forks source link

CI: management of assets #67

Closed ambroise-arm closed 2 years ago

ambroise-arm commented 2 years ago

Align with ModelZoo versioning design: https://github.com/autowarefoundation/modelzoo/issues/63

Now generate archives per model/backend combination instead of having a single one, allowing finer grained downloads and bandwidth savings.

Add versioning to the compiled models.

ambroise-arm commented 2 years ago

@xmfcx Are you interested in reviewing this? It is very similar to what you had proposed here: https://github.com/autowarefoundation/modelzoo/issues/63#issuecomment-1113128225. I didn't keep the whole directory structure inside of the bucket because it was redundant with the information contained in the file name. So in this patch the archives are stored under bucket_dir/models/version_and_date/model_name-model_arch-model_backend-version_and_date.

After this gets merged, handling the new data structure in Autoware will require some modifications to the packages that make use of the models. I have a patch for that but I'll wait for https://github.com/autowarefoundation/autoware.universe/pull/893 and https://github.com/autowarefoundation/autoware.universe/pull/1181 to get merged first.