search

cct-datascience / group-procedures

Quarto book/wiki of group procedures and resources
https://cct-datascience.github.io/group-procedures/
Creative Commons Attribution 4.0 International
0 stars 0 forks source link

Add action to check URLs #77

Closed Aariq closed 2 days ago

Aariq commented 2 weeks ago

Given that academic website URLs often change with no redirect, it might be nice to have a GitHub action that automatically checks for invalid URLs.

Such an action exists here: https://github.com/lycheeverse/lychee-action

Aariq commented 2 weeks ago

Just ran it on this repo and here's an example of the output. Would need to do some work to exclude certain links (e.g. private project boards) and files (e.g. _extensions/) and/or create a custom token that has permissions to "see" our organizations private project boards.

`lychee *.qmd` output ``` 283/283 ━━━━━━━━━━━━━━━━━━━━ Finished extracting links Issues found in 15 inputs. Find details below. [general-info.qmd]: ✗ [422] https://keating.bio5.org/ticket_support/tickets.php | Failed: Network error: Unprocessable Entity [sprint-planning.qmd]: ✗ [404] https://github.com/orgs/cct-datascience/projects/8/ | Failed: Network error: Not Found ✗ [404] https://github.com/orgs/cct-datascience/projects/8/views/10 | Failed: Network error: Not Found ✗ [401] https://docs.google.com/spreadsheets/d/1k4B59FdpGxAd2sNrgbXRLrYIVgcxjvnYF5yJoaIcOAA/edit#gid=0 | Failed: Network error: Unauthorized [hiring.qmd]: ✗ [404] https://community.rstudio.com/t/post-jobs-gigs-here/9254 | Failed: Network error: Not Found ✗ [ERR] https://ucap.arizona.edu/content/university-staff-pay-structure | Failed: Network error: error sending request for url (https://ucap.arizona.edu/content/university-staff-pay-structure) ✗ [ERR] https://ucap.arizona.edu/career-architecture/work-dimensions-staff-pay-structure | Failed: Network error: error sending request for url (https://ucap.arizona.edu/career-architecture/work-dimensions-staff-pay-structure) ✗ [ERR] https://ucap.arizona.edu/ | Failed: Network error: error sending request for url (https://ucap.arizona.edu/) [onboarding.qmd]: ✗ [404] https://github.com/orgs/cct-datascience/projects/7 | Failed: Network error: Not Found ✗ [401] https://docs.google.com/spreadsheets/d/18ANZGFdBHBU8l9WbFTE0fErcCaTva3LyazuhAex4FFE/edit#gid=129820665 | Failed: Network error: Unauthorized ✗ [404] https://github.com/orgs/cct-datascience/projects/8 | Failed: Network error: Not Found ✗ [403] https://hackmd.io/team/cct-datascience?nav=overview | Failed: Network error: Forbidden ✗ [401] https://docs.google.com/spreadsheets/d/1N95GgtAgvpQ9PhpiYwqWYewWu-FOzeIoQxzX2oldUuk/edit?usp=sharing | Failed: Network error: Unauthorized [incubator.qmd]: ✗ [404] https://github.com/orgs/cct-datascience/projects/7 | Failed: Network error: Not Found ✗ [ERR] https://casrai.org/credit/ | Failed: Network error: error sending request for url (https://casrai.org/credit/) [publishing-to-web.qmd]: ✗ [404] https://datascience.arizona.edu/analytics-powerhouse/rstudio-connect | Failed: Network error: Not Found [code-of-conduct.qmd]: ✗ [ERR] https://arizona-advocate.symplicity.com/public_report | Failed: Too many redirects: error following redirect for url (https://arizona-advocate.symplicity.com/public_report/index.php/pid631305?) [impact.qmd]: ✗ [401] https://docs.google.com/spreadsheets/d/1jHzCgfyQLcKOuMIJpCqlS--nDgs5hIEQ-8dOafaIUlw/edit#gid=0 | Failed: Network error: Unauthorized ✗ [401] https://docs.google.com/document/d/1m8X8kVeEIDU9Xo3xzLXr0kb2HL_aQYYoh5Qp8a33wHI/edit#heading=h.bfh5rd50u0d7 | Failed: Network error: Unauthorized ✗ [401] https://docs.google.com/spreadsheets/d/1Ji9A_Aozb8Hp15b2JrLHx4lqoiJXae883Fga71rqkuM/edit#gid=127724424 | Failed: Network error: Unauthorized ✗ [401] https://docs.google.com/spreadsheets/d/19Nxa4HiCYmQ4oXa41XR7kBIpRoatxD-Efp0VBUpRLDk/edit#gid=0 | Failed: Network error: Unauthorized ✗ [401] https://docs.google.com/spreadsheets/d/1TNv0PG2iqRSLJJxX7mBFBsO0j1_EpabGH8Auqk3obEw/edit#gid=0 | Failed: Network error: Unauthorized [networking.qmd]: ✗ [401] https://docs.google.com/spreadsheets/d/1jHzCgfyQLcKOuMIJpCqlS--nDgs5hIEQ-8dOafaIUlw/edit#gid=0 | Failed: Network error: Unauthorized [regular-meetings.qmd]: ✗ [404] https://github.com/orgs/cct-datascience/projects/7 | Failed: Network error: Not Found ✗ [404] https://github.com/orgs/cct-datascience/projects/9 | Failed: Network error: Not Found ✗ [401] https://docs.google.com/spreadsheets/d/1k4B59FdpGxAd2sNrgbXRLrYIVgcxjvnYF5yJoaIcOAA/edit?usp=sharing | Failed: Network error: Unauthorized [workshops.qmd]: ✗ [401] https://docs.google.com/spreadsheets/d/1SU8Wtx7Ku1IMv8DOAU-37E12-AZP0CjnRy1vPSkmNGQ/edit#gid=0 | Failed: Network error: Unauthorized ✗ [401] https://docs.google.com/spreadsheets/d/155tcna1dMWwsZymdKFZPCrnZf3xocw4hPv1JKwOu9MQ/edit#gid=0 | Failed: Network error: Unauthorized ✗ [404] https://datascience.cals.arizona.edu/services-overview/workshops | Failed: Network error: Not Found [group-expectations.qmd]: ✗ [404] https://hr.arizona.edu/employees-affiliates/leaves/university-winter-closure | Failed: Network error: Not Found ✗ [401] https://calendar.google.com/calendar/embed?src=c_2c2cc9b6aa62ca6f9fc2fcc2d8558836290595f7a5db54fa5610d5da4f5d3346%40group.calendar.google.com&ctz=America%2FPhoenix | Failed: Network error: Unauthorized [outreach-communication.qmd]: ✗ [ERR] https://bcf.arl.arizona.edu/news | Failed: Network error: error sending request for url (https://bcf.arl.arizona.edu/news) ✗ [404] https://datascience.cct.arizona.edu/all-news | Failed: Network error: Not Found ✗ [401] https://docs.google.com/document/d/1LIxkktiP219_Xd24vXpgA1Qz7j7WcuRORtN26p2Qujw/edit | Failed: Network error: Unauthorized ✗ [ERR] https://www.labsexplorer.com/c/twitter-and-scientists-a-love-story_185 | Failed: Network error: error sending request for url (https://www.labsexplorer.com/c/twitter-and-scientists-a-love-story_185) [annual-reviews.qmd]: ✗ [404] https://hr.arizona.edu/sites/default/files/UACareerConversation%20Form.docx | Failed: Network error: Not Found ✗ [404] https://hr.arizona.edu/supervisors/performance-management/performance-feedback-faqs | Failed: Network error: Not Found ✗ [404] https://hr.arizona.edu/sites/default/files/hr/forms/HR-Conversations/UACareerConversationGuide.pdf | Failed: Network error: Not Found ✗ [404] https://hr.arizona.edu/sites/default/files/SMART-Goal-Setting-Template.pdf | Failed: Network error: Not Found ✗ [404] https://hr.arizona.edu/sites/default/files/Career%20Conversations%20in%20a%20Remote%20Setting.pdf | Failed: Network error: Not Found [software.qmd]: ✗ [404] https://docs.hpc.arizona.edu/display/UAHPC/HPC+Documentation | Failed: Network error: Not Found 🔍 283 Total (in 5s) ✅ 219 OK 🚫 41 Errors 💤 23 Excluded 💡 There were issues with GitHub URLs. You could try setting a GitHub token and running lychee again.% ```
KristinaRiemer commented 2 weeks ago

That is...a LOT of broken links 🚨

Aariq commented 2 weeks ago

Yeah, I suggest we merge #78 and then fix the broken links in a separate PR.