OS Hub Matching Dedupe Architecture Changes

opensupplyhub / open-apparel-registry

An application for searching, matching, uploading factories.

MIT License

32 stars 13 forks source link

OS Hub Matching Dedupe Architecture Changes #2031

Open jwalgran opened 2 years ago

jwalgran commented 2 years ago

An epic covering tasks for updating the platform to use the latest version of dedupe, using the database to share trained models and data between workers, and making model training a scheduled background process rather than running each time a web process is started.

TaiWilkin commented 2 years ago

@jwalgran Can we move this to verified?

jwalgran commented 1 year ago

Two things make me think that this should not yet be moved to Verified

This the changes have not been merged due to a lingering, unresolved performance issue.
We do not have code that would train models in the background on a regular schedule, a feature described in the issue description.