maybe add simple animations on landing page, some eye candy
"I don't know what FAIR is" maybe add context with a link
call to action for each of the links (data/ and software/)
move logos to the bottom
53
consider adding a textual indication of the logo link targets
indicate what is going to happen when you click the software or data link, before you click the link; indicate time expectation management
repeat favicon logo in the site content for brand building
About the data route:
liked background
Something feels off about the title, maybe use "Self-assessment checklist for FAIR data"? :heavy_check_mark: done
"or switch to the checklist for sofware instead" maybe replace with "if you want to check the FAIRness of your software, use this link."
expectation management on what is going to happen before users go through the form. Something like "We have questions in 4 categories, you'll see the bars at the bottom update as you go along"
aspect heading now just says Findable, consider adding context to explain what Findable means within FAIR
55 (data)
reddish color of the 2nd progress bar suggests something is wrong
question 7: merge "No" and "Unsure" answers, they award the same points
what does Interoperable mean. Maybe add a context section under the H2 headings
question 9: some questions are difficult to answer because my option isn't there. Maybe add a field "Other"
Avoid overlaying the form content with the progress bars, it might be cleaner to have two rows, with the questions content div scrollable
After you complete the questions, add something about what's next, or some kind of closer message
Reviewer observes: "This checklist is useful but I didn't enjoy the process of filling it out"
How can I get help for a given question if something isn't clear; maybe add a "Read more..." section
target="_blank" on "Report an issue"
use dedicated issue template on the GitHub new issue link
48
consider making the ARDC logo text large enough to be readable
Bug: I can sometimes select two things, related to going to GitHub in between. Happens on desktop + Arch Linux + Edge. Reproduce with: select option 0 on the first question, go to GitHub via link (in the same tab), click Back button, now select option 1 on the first question, now both options are checked.
51
About the software route:
liked different color from data route
why can I get a badge for software but not data?
"Answer the N questions below" it's not telling me much to have a number there, just do "Answer the questions below" :heavy_check_mark: done
confusing text, suggests you're doing it wrong when there is one component. Not fair if you went through the trouble of refactoring your code into being only a reusable library without any extras
"rich" metadata what does it mean?
difficult question, FAIRness of metadata is unclear what it means
what is "standardised" protocols?; if 7 is answered with no, hide questions 8 and 9, or at least 9. Also there is a typo in the possessive.
"software is no longer available" what does it mean? The phrasing could be SMARTer
difference between b and c, what happens if your software does both, for example export as CSV (generic) and as FIT (domain-specific)
what "data"?
what does "easy" mean? Also the type of documentation matters: e.g. developer docs v user docs. For option 3, consider replacing with something like: "Software is available in binary form and its documentation covers how to incorporate or extend"
maybe too complicated but what about portability between OSes, tool chains; phrasing of the answers does not cover the possible cases
What makes a license "standard"? What makes a license "machine readable"?
Reviewer suggests to not have this question, but instead only ask about technical / reproducibility aspects of provenance, not the project aspects. Reviewer doesn't see how project information is helping reproducibility.
Phrasing is confusing. Maybe split the answers into a group about dependencies and a group about other software.
"I feel like I'm solving a puzzle in every question" What is a standard? Confusing question. JHS: Maybe rephrase as "How much have domain-relevant practices been considered in writing the software?"
Reviewer observes: "checklist not a good fit for a package like python-template"
About "Get the badge" section
what do I do with the badge, maybe add text under heading
consider hiding the snippets behind a dropdown to not scare people with code
About progress bars:
Consider adding some kind of congratulations to the progress bars
Reviewer observes: "number of questions may be too many"
Notes from review session Nov 30, 2022
code state: https://github.com/ardc-fair-checklist/ssg/tree/ce660569c3bbedaf3f5a508113bf460f02e60b86
About landing page:
53
About the data route:
55 (data)
target="_blank"on "Report an issue"48
51
About the software route:
Reviewer filled out the form for https://github.com/NLeSC/python-template
(Numbers are question numbers)
Reviewer observes: "checklist not a good fit for a package like python-template"
About "Get the badge" section
About progress bars:
Reviewer observes: "number of questions may be too many"