stac-extensions / ml-model

An Item and Collection extension to describe machine learning (ML) models that operate on Earth observation data.
Apache License 2.0
37 stars 0 forks source link

deprecated in favor of MLM extension #16

Open fmigneault opened 4 months ago

fmigneault commented 4 months ago

The Machine Learning Model (MLM) extension (https://github.com/crim-ca/mlm-extension) combines the fields that were previously defined in the Deep Learning Model (DLM) extension as well as most (all?) fields proposed by ML-Model. Some fields are renamed to avoid redundant details between the 2 references, while others are adjusted to allow more flexibility (e.g.: not just docker-compose runtime, but virtually anything). More best-practices and examples are provided to demonstrate the use of MLM along other STAC extensions to take advantage of the full STAC ecosystem.

Schema for MLM: https://crim-ca.github.io/mlm-extension/v1.0.0/schema.json

Fixes #13

m-mohr commented 4 months ago

Waiting for https://github.com/orgs/stac-utils/discussions/4 to be discussed.

If we go forward with this PR, we should not forget to archive this extension via the GH settings.

HamedAlemo commented 4 months ago

Echoing @m-mohr, based on the outcome of https://github.com/orgs/stac-utils/discussions/4, this should be deprecated.

emmanuelmathot commented 4 months ago

Instead, I think this extension should not be deprecated until the new one increased its maturity level to Candidate.

fmigneault commented 4 months ago

"Candidate" is a long way off. MLM is already at "Pilot", which is 1 level higher than ML-Model has been on for ~3 years.

I need https://github.com/stac-extensions/stac-extensions.github.io/pull/48 to be integrated to reflect the latest changes and increase adoption.

emmanuelmathot commented 4 months ago

Actually, ml-model should be in "Candidate" level but was never reviewed. Anyway, my view here is to not deprecate so quickly an extension by another which in not actually covering the same purpose.

fabricebrito commented 4 months ago

I'm in favour of keeping this extension as its purpose is valid and needed. This extension doesn't prevent the MLM from existing. Looking forward for https://github.com/stac-extensions/ml-model/pull/17

fmigneault commented 4 months ago

@fabricebrito

That's the whole issue and reason about deprecating ML-model. ML-model is not planned to receive any maintenance, so #17 will most probably not be included.

Instead, efforts should be done in MLM to include any necessary adjustments (if they are actually required) to support all use cases with a single extension. Looking at the PR, I think this is already possible with MLM in its current state, since all ml-model roles have a corresponding mlm role (https://github.com/crim-ca/mlm-extension?tab=readme-ov-file#mlm-asset-roles), and it doesn't impose any limitation about docker-compose for its runtime.

rbavery commented 1 month ago

Hi everyone, Francis and I (maintainers of the MLM) have agreed that the stac-extensions repo is the best home for the MLM extension.

We got approval from CRIM, who owns the current MLM github repo, to move the extension. Given that we don't want to have two competing specs and the MLM can accommodate docker-compose I think this extension should be deprecated.

The MLM extension has evolved quite a bit to meet a range of needs when describing models today. I think we should focus efforts on the MLM once a move is approved to the stac-extensions repo (working on this now in the Gitter channel). We are open to others providing input as contributors and maintainers as we continue to improve the schema and tooling around the MLM spec and would like the MLM to be collaborative and community driven.