[Batch] Slack: Prompt Slack Users to Test New Model Submissions

ersilia-os / ersilia

The Ersilia Model Hub, a repository of AI/ML models for infectious and neglected disease research.

https://ersilia.io

GNU General Public License v3.0

224 stars 148 forks source link

Closed D1M1TR10S closed 1 year ago

D1M1TR10S commented 1 year ago

Summary: Prompt Slack users to test new submissions when they're posted to Slack.

D1M1TR10S commented 1 year ago

Some people on Slack don't have GitHub(50%), but many have both. It would be great if non-GitHub users could test the models too though.

In GitHub: Could create issues and assign them to a person within a team. Have a team of testers with GitHub collaborator status.

Two audiences:

Internal team and testers – testing that things work in a diverse set of users and OSes.
External users and scientists – testing more about usefulness and user experience. These users are accessing Ersilia via the CLI in the terminal.

D1M1TR10S commented 1 year ago

Start with Internal team/testers audience in GitHub. After that, we'll scale out to the wider audience of users/scientists.

Trigger event:

After the model incorporating pipeline is finished (as soon as a model works and passes automated tests)
Explicit trigger: At the end of the PR that passes all checks
Create issue for review from @miquelduranfrigola or @GemmaTuron

Manual task for trigger to be set off:

@miquelduranfrigola or @GemmaTuron will add a label to the issue for it to be posted to Slack for review

Jobs:

Create an issue and assign it to team member, which will post the new model to Slack for testing.

Use versioning as a trigger? (v0.01 for example) – perhaps in the future. No versioning now.

Current tempo: a few models every week. (10-15 or so every week at the most.)

megamanics commented 1 year ago

[x] Name of the team
[x] Create team
[x] Create Slack Channel [Model Announcements]
[x] Create Slack Bot
[x] Create Slack Token Secret at org level
[x] Assign test members to Github Team
[x] Invite test members to Slack Channel
[ ] Add round robin assignment logic for team issues
[x] https://github.com/ersilia-os/github-partners/issues/7
[x] https://github.com/ersilia-os/eos-template/pull/5
[ ] Add action release tag to repo
[ ] Create Action / App based on tag to create an issue and assign to team repo
[ ] https://github.com/ersilia-os/ersilia/issues/478

GemmaTuron commented 1 year ago

this is related to #478