[Docs] Craft an official description of the three core concepts of OC - Githubissues

Sage-Bionetworks / sage-monorepo

Where OpenChallenges, Schematic, and other Sage open source apps are built

https://sage-bionetworks.github.io/sage-monorepo/

Apache License 2.0

21 stars 12 forks source link

[Docs] Craft an official description of the three core concepts of OC #2171

Closed tschaffter closed 9 months ago

tschaffter commented 11 months ago

What product(s) is this documentation issue for?

OpenChallenges

Documentation issue

[ ] Reporting a typo
[ ] Reporting a documentation bug
[ ] Documentation improvement
[ ] Documentation feedback

Description

The three core concepts are introduced as metrics on the top of the home page. They are:

challenge
organizations & hosting societies
challenge platforms

Discussions with stakeholders revealed that it was not always clear whether an "entity" was a platform and/or an organization.

The goal of this ticket is to craft descriptions for these three concepts. The description could be use as tooltips in the web app or printed on one of the pages.

Is there a specific documentation page you are reporting?

No response

Anything else?

No response

Code of Conduct

[X] I agree to follow this project's Code of Conduct

tschaffter commented 11 months ago

Tentatively assigning this task to @gaiaandreoletti to start with a fresh pair of eyes.

gaiaandreoletti commented 11 months ago

pasting here the core concepts description:

Glossary Challenge: a call to take part in a contest or competition. Challenges are typically built on large and complex data sets, focused on scientifically impactful and timely research questions. They result in a set of solutions to the given problem, originating from groups and researchers all over the world.

Benchmark: systematic assessment of the performance of a variety of methods for a given task normally based on defined case studies and metrics.

Platform: any hardware or software used to host an application or service. (e.g. synapse, Drupal, etc.)

Organization: describe a research modality where diverse and independent researchers come together to focus on one or more limited sets of tasks.

gaiaandreoletti commented 11 months ago

@tschaffter @vpchung @rrchai

Some feedback during lunch post OC talk:

1) having the sage logo also in the Team page. It should be more prominent to recognize the effort Sage put. 2) Having benchmarking not only challenges in the portal so I suggest reframing the text as

"OpenChallenges (OC) is a centralized hub for biomedical challenges and more, offering a benchmarking system that empowers participants with the most up-to-date information about relevant challenges, while providing organizers with standardized challenge event templates and intelligence."

gaiaandreoletti commented 10 months ago

[ ] Meet our team page is outdated

tschaffter commented 10 months ago

Meet our team page is outdated

This issue is tracked in #2197

tschaffter commented 10 months ago

OpenChallenges (OC) is a centralized hub for biomedical challenges and more, offering a benchmarking system that empowers participants with the most up-to-date information about relevant challenges, while providing organizers with standardized challenge event templates and intelligence.

I think that the term "benchmarking system" may confuse the user by making them think that OC is a challenge/benchmarking platform, which OC is not.

tschaffter commented 10 months ago

@gaiaandreoletti Please add the descriptions from https://github.com/Sage-Bionetworks/sage-monorepo/issues/2171#issuecomment-1741235093 to a Google doc before inviting the OC team member to make suggestions.

Here is some feedback:

Challenge: this description resonates with me. Maybe mention the terms "task" and "leaderboard" as an attempt to further standardize our vocabulary. Consider mentioning that a challenge is usually active for a fixed duration.
Platform: we need a more tailored description. A platform could be described as a service that enable the organization of challenges. Potentially include the list of actions that platforms support, such as participant registration, evaluation of submitted methods, leaderboard generation, communication tools, etc.
Organization: An organization in OC means https://en.wikipedia.org/wiki/Organization. The description could be "an entity such as a company, an institution, or an association comprising one or more people and having a particular purpose". Maybe the description could establish the relationship between an org and challenges, e.g. referring to orgs that contribute to a challenge as a member of its organizing committee or as a participating member (OC does not yet capture orgs that participated to challenges as participant).

tschaffter commented 10 months ago

@gaiaandreoletti I think that you created the Google doc but can't find it. Can you share the link to this thread?

gaiaandreoletti commented 10 months ago

@tschaffter here it is! https://docs.google.com/document/d/1T0DStWW06X9VOHZ7fUElaOmJKIKAsDYy_J5JZi1K8IA/edit?usp=sharing

gaiaandreoletti commented 10 months ago

@tschaffter updated link: https://docs.google.com/document/d/1XVfn3vGw3OsuATfhQVO281aV65wh0PI6/edit?usp=drive_link&ouid=106220044830802031009&rtpof=true&sd=true move it to the OpenChallenges shared folder

tschaffter commented 10 months ago

I created a native Google Docs here (instead of a Word doc)

tschaffter commented 10 months ago

Added to Sprint 23.11

tschaffter commented 9 months ago

I'm going to time box this issue and close it. The existing descriptions are available in OpenChallenges Glossary. More feedback would be required to use them in the app. Meanwhile, they already clarify for us what a challenge platform is.