Migrate off Gatsby

[awendland]

Gatsby has been broken since June 2023. After ~2 hours of trying to upgrade various dependencies I can't get builds working again. I've tried:

• Removing gatsby-source-google-docs while staying on Node 12 - errors because sharp fails to install correctly) - i23-node-12.18.0-remove-google-docs
• Upgrading lmdb while staying on Node 12 - errors because gatsby-source-filesystem@5.8.0 requires node 18, and 5.8.0 is required to fix 59ef639529af5dcea518bd0f8dcfc7a5aa31f328)
• Upgrading lmdb and Node to 18 - errors because "Something went wrong installing the "sharp" module" - i23-node-18.19.0-upgrade-lmdb
• Upgrading lmdb and sharp and Node to 18 - errors because of OOM issues with the GC - i23-node-18.19.0-upgrade-lmdb-sharp
• Upgrading everything and Node to 18 - errors because of require usage of clipboardy/etc. dependencies - i23-node-18.19.0-upgrade-everything-latest
• Upgrading everything and Node to 18 + using resolutions to back-date modules to allow require imports - this is too much effort

[awendland]

Issues with Gatsby:

• Dependencies get out of date and require large coordinated upgrading effort
• Unable to use a single, archived binary to build the website
• [not a Gatsby-inherent issue] Reliance on real-time import of content sources, instead of saving everything to local filesystem (collected notes, google docs)

[awendland]

Migration checklist:

• [x] content/blog
• [x] content/notes
• [x] content/blurbs
• [x] Collected Notes - https://collectednotes.com/awendland.json
• [x] Google Docs
  • [x] Big Trees - how to handle images?
  • [x] Healthcare
• [x] Preserve existing URLs
• [x] /cms
• [x] GoatCounter
• [x] RSS Feed
• [x] 404-error page
• [x] In-page links to headers
• [x] UI for code rendering - fix font size on iOS
• [x] Metadata
  • [x] Title: "Alex W's Blog"
  • [x] Title suffix w/ " | Alex W.'s Blog"
  • [x] Favicon

[awendland]

Sitemap

```html https://blog.alexwendland.com/2023-05-09-to-combat-altruist-schwab-should-buy-advyzon/ daily 0.7 https://blog.alexwendland.com/2023-02-17-recommended-1-1-topics-for-early-employees-and-startup-executives/ daily 0.7 https://blog.alexwendland.com/2023-01-02-my-programming-trends-from-2020-to-2022/ daily 0.7 https://blog.alexwendland.com/2022-12-22-30-houseplants-in-a-nyc-apartment/ daily 0.7 https://blog.alexwendland.com/2021-12-24-the-fda-approved-luminopia-one/ daily 0.7 https://blog.alexwendland.com/2021-09-20-chunked-iteration-in-python/ daily 0.7 https://blog.alexwendland.com/2021-09-19-onboarding-to-python-fastapi-sqlalchemy-2021/ daily 0.7 https://blog.alexwendland.com/2021-02-18-citi-loses-500m-and-why-verification-uis-should-switch-modes/ daily 0.7 https://blog.alexwendland.com/2021-03-15-release-wasm_spec_kernel-a-jupyter-kernel-for-webassembly/ daily 0.7 https://blog.alexwendland.com/2020-12-28-debug-trace-logging-in-a-custom-jupyter-kernel/ daily 0.7 https://blog.alexwendland.com/2020-11-17-extract-color-configurations-from-an-iterm-profile/ daily 0.7 https://blog.alexwendland.com/2020-11-07-script-the-installation-of-deb-packages-that-have-configuration-prompts/ daily 0.7 https://blog.alexwendland.com/2020-09-25-translucent-status-bar-in-pwas-on-ios/ daily 0.7 https://blog.alexwendland.com/2020-08-16-different-homebrew-formula-approaches-for-go-binaries/ daily 0.7 https://blog.alexwendland.com/2020-07-14-supporting-cli-programs-in-subprocess-run-on-macos-windows-without-shell-true/ daily 0.7 https://blog.alexwendland.com/2020-07-06-using-filetype-to-guess-chk-files-in-found-000/ daily 0.7 https://blog.alexwendland.com/2020-07-02-sending-email-from-a-forwarding-only-address-in-gmail/ daily 0.7 https://blog.alexwendland.com/2020-07-01-custom-json-payload-for-get-contents-of-url-in-ios-shortcuts/ daily 0.7 https://blog.alexwendland.com/2020-06-25-typescript-lerna-and-dockerignore/ daily 0.7 https://blog.alexwendland.com/2020-06-21-connecting-to-host-machine-from-docker-container-on-macos/ daily 0.7 https://blog.alexwendland.com/2020-06-19-how-to-work-with-streams-in-got/ daily 0.7 https://blog.alexwendland.com/2020-06-19-how-to-implement-max-download-size-with-got/ daily 0.7 https://blog.alexwendland.com/2020-06-17-feedly-intentionally-sets-the-wrong-rss-date/ daily 0.7 https://blog.alexwendland.com/2020-06-16-tasks-and-promises-in-fp-ts/ daily 0.7 https://blog.alexwendland.com/2020-06-09-release-bedsheets/ daily 0.7 https://blog.alexwendland.com/2021-03-16-graduated-from-harvard/ daily 0.7 https://blog.alexwendland.com/2020-04-10-senior-thesis/ daily 0.7 https://blog.alexwendland.com/2018-11-23-google-drive-backup/ daily 0.7 https://blog.alexwendland.com/2018-11-20-npm-install-scripts-intro/ daily 0.7 https://blog.alexwendland.com/2018-06-08-yarn-vs-npm/ daily 0.7 https://blog.alexwendland.com/2015-05-13-the-second-quarter-of-2015-projects/ daily 0.7 https://blog.alexwendland.com/2015-05-13-the-second-quarter-of-2015-items/ daily 0.7 https://blog.alexwendland.com/2015-02-20-particle-network-js-animations/ daily 0.7 https://blog.alexwendland.com/2014-08-10-algorithmic-art-in-javascript/ daily 0.7 https://blog.alexwendland.com/2014-05-26-linux-terminal-one-line-batch-download/ daily 0.7 https://blog.alexwendland.com/2014-03-28-android-the-better-ux/ daily 0.7 https://blog.alexwendland.com/2013-08-27-alarmmanager-broadcastreceivers-activities/ daily 0.7 https://blog.alexwendland.com/2013-08-03-a-foray-into-angularjs/ daily 0.7 https://blog.alexwendland.com/2013-08-03-an-ongoing-comparison-of-brackets-and-sublime-text-3/ daily 0.7 https://blog.alexwendland.com/2013-07-27-robotics-subject-thats-lacking/ daily 0.7 https://blog.alexwendland.com/2013-07-23-stem-training-that-matters/ daily 0.7 https://blog.alexwendland.com/2013-07-17-sat-prompt-1/ daily 0.7 https://blog.alexwendland.com/2013-07-09-why-start-a-blog/ daily 0.7 https://blog.alexwendland.com/2011-06-08--disable-right-click/ daily 0.7 https://blog.alexwendland.com/2011-06-07--xbox-goes-rrod-take-my-drill/ daily 0.7 https://blog.alexwendland.com/2011-05-18--ubuntu-flash-3/ daily 0.7 https://blog.alexwendland.com/2011-05-18--gnome-notif-bubbles-in-ubuntu/ daily 0.7 https://blog.alexwendland.com/2011-05-06--nautilus-elementary-breadcrumbs/ daily 0.7 https://blog.alexwendland.com/2011-05-06--pithos-the-quiter/ daily 0.7 https://blog.alexwendland.com/2011-04-23--screen-on-screen-off/ daily 0.7 https://blog.alexwendland.com/2011-04-23--stupid-mac/ daily 0.7 https://blog.alexwendland.com/2011-04-22--multiple-firefox-windows/ daily 0.7 https://blog.alexwendland.com/2011-04-21--dvd-still-rippin/ daily 0.7 https://blog.alexwendland.com/2011-04-21--ubuntu-i-control-my-hardrive/ daily 0.7 https://blog.alexwendland.com/2011-04-21--restart/ daily 0.7 https://blog.alexwendland.com/2010-06-27--day-7-later-on/ daily 0.7 https://blog.alexwendland.com/2010-06-25--day-7/ daily 0.7 https://blog.alexwendland.com/2010-06-25--day-6/ daily 0.7 https://blog.alexwendland.com/2010-06-22--day-4/ daily 0.7 https://blog.alexwendland.com/2010-06-22--day-3/ daily 0.7 https://blog.alexwendland.com/2010-06-21--day-2/ daily 0.7 https://blog.alexwendland.com/2010-06-19--day-1/ daily 0.7 https://blog.alexwendland.com/notes-dev-resources/ daily 0.7 https://blog.alexwendland.com/notes-big-trees/ daily 0.7 https://blog.alexwendland.com/notes-gender-diversity/ daily 0.7 https://blog.alexwendland.com/notes-healthcare/ daily 0.7 https://blog.alexwendland.com/ daily 0.7 ```

[awendland]

Consider using Hugo:

• https://gohugo.io/getting-started/quick-start/
• https://dev.to/geekgalgroks/how-to-convert-a-simple-blog-from-gatsby-to-hugo-3jic
• https://github.com/spech66/hugo-best-practices
• Themes
  • https://themes.gohugo.io/themes/blank/
  • https://themes.gohugo.io/themes/hugo-bearblog/

Misc. Tools:

• https://github.com/erikh/gdocs-export

[awendland]

I ran the previous Gatsby-generated sitemap.xml through lychee to check that existing links worked. The output was as expected after 18482ac.

Output

``` ❯ docker run --init -it --rm -w /input -v $(pwd):/input lycheeverse/lychee prev-sitemap.xml -v ? [EXCLUDED] http://www.w3.org/1999/xhtml | Excluded ✗ [404] http://www.google.com/schemas/sitemap-mobile/1.0 | Failed: Network error: Not Found ✔ [200] https://blog.alexwendland.com/2021-09-19-onboarding-to-python-fastapi-sqlalchemy-2021/ ✔ [200] https://blog.alexwendland.com/2011-06-08--disable-right-click/ ✔ [200] https://blog.alexwendland.com/2013-08-03-an-ongoing-comparison-of-brackets-and-sublime-text-3/ ✔ [200] https://blog.alexwendland.com/2020-07-14-supporting-cli-programs-in-subprocess-run-on-macos-windows-without-shell-true/ ✔ [200] https://blog.alexwendland.com/2010-06-22--day-3/ ✔ [200] https://blog.alexwendland.com/2010-06-22--day-4/ ✔ [200] https://blog.alexwendland.com/2023-05-09-to-combat-altruist-schwab-should-buy-advyzon/ ✔ [200] https://blog.alexwendland.com/2020-07-02-sending-email-from-a-forwarding-only-address-in-gmail/ ✔ [200] https://blog.alexwendland.com/2018-11-23-google-drive-backup/ ✔ [200] https://blog.alexwendland.com/2011-05-06--pithos-the-quiter/ ✔ [200] https://blog.alexwendland.com/2013-07-17-sat-prompt-1/ ✔ [200] https://blog.alexwendland.com/2011-06-07--xbox-goes-rrod-take-my-drill/ ✔ [200] https://blog.alexwendland.com/2014-08-10-algorithmic-art-in-javascript/ ✔ [200] https://blog.alexwendland.com/2010-06-19--day-1/ ✔ [200] https://blog.alexwendland.com/2021-03-16-graduated-from-harvard/ ✔ [200] https://blog.alexwendland.com/2011-04-21--dvd-still-rippin/ ✔ [200] https://blog.alexwendland.com/2020-09-25-translucent-status-bar-in-pwas-on-ios/ ✔ [200] https://blog.alexwendland.com/2023-01-02-my-programming-trends-from-2020-to-2022/ ✔ [200] https://blog.alexwendland.com/2010-06-21--day-2/ ✔ [200] https://blog.alexwendland.com/2020-06-21-connecting-to-host-machine-from-docker-container-on-macos/ ✔ [200] https://blog.alexwendland.com/2010-06-27--day-7-later-on/ ✔ [200] https://blog.alexwendland.com/2020-06-25-typescript-lerna-and-dockerignore/ ✔ [200] https://blog.alexwendland.com/2015-02-20-particle-network-js-animations/ ✔ [200] https://blog.alexwendland.com/2011-04-21--restart/ ✔ [200] https://blog.alexwendland.com/2011-05-18--ubuntu-flash-3/ ✔ [200] https://blog.alexwendland.com/2021-02-18-citi-loses-500m-and-why-verification-uis-should-switch-modes/ ✔ [200] https://blog.alexwendland.com/2020-06-19-how-to-work-with-streams-in-got/ ✔ [200] https://blog.alexwendland.com/2021-12-24-the-fda-approved-luminopia-one/ ✔ [200] https://blog.alexwendland.com/2020-08-16-different-homebrew-formula-approaches-for-go-binaries/ ✔ [200] https://blog.alexwendland.com/2011-04-22--multiple-firefox-windows/ ✔ [200] https://blog.alexwendland.com/2011-04-21--ubuntu-i-control-my-hardrive/ ✔ [200] https://blog.alexwendland.com/2023-02-17-recommended-1-1-topics-for-early-employees-and-startup-executives/ ✔ [200] https://blog.alexwendland.com/2022-12-22-30-houseplants-in-a-nyc-apartment/ ✔ [200] https://blog.alexwendland.com/2013-08-27-alarmmanager-broadcastreceivers-activities/ ✔ [200] https://blog.alexwendland.com/2010-06-25--day-7/ ✔ [200] https://blog.alexwendland.com/2011-04-23--stupid-mac/ ✔ [200] https://blog.alexwendland.com/2011-05-06--nautilus-elementary-breadcrumbs/ ✔ [200] https://blog.alexwendland.com/2021-03-15-release-wasm_spec_kernel-a-jupyter-kernel-for-webassembly/ ✔ [200] https://blog.alexwendland.com/notes-dev-resources/ ✔ [200] http://www.google.com/schemas/sitemap-image/1.1 ✔ [200] https://blog.alexwendland.com/2020-11-07-script-the-installation-of-deb-packages-that-have-configuration-prompts/ ✔ [200] https://blog.alexwendland.com/2020-07-01-custom-json-payload-for-get-contents-of-url-in-ios-shortcuts/ ✔ [200] https://blog.alexwendland.com/2015-05-13-the-second-quarter-of-2015-projects/ ✔ [200] https://blog.alexwendland.com/2020-06-16-tasks-and-promises-in-fp-ts/ ✔ [200] https://blog.alexwendland.com/2013-08-03-a-foray-into-angularjs/ ✔ [200] http://www.google.com/schemas/sitemap-video/1.1 ✔ [200] https://blog.alexwendland.com/2013-07-23-stem-training-that-matters/ ✔ [200] https://blog.alexwendland.com/2014-05-26-linux-terminal-one-line-batch-download/ ✔ [200] https://blog.alexwendland.com/2018-11-20-npm-install-scripts-intro/ ✔ [200] https://blog.alexwendland.com/2021-09-20-chunked-iteration-in-python/ ✔ [200] https://blog.alexwendland.com/2011-05-18--gnome-notif-bubbles-in-ubuntu/ ✔ [200] https://blog.alexwendland.com/2011-04-23--screen-on-screen-off/ ✔ [200] https://blog.alexwendland.com/2020-06-17-feedly-intentionally-sets-the-wrong-rss-date/ ✔ [200] https://blog.alexwendland.com/2020-12-28-debug-trace-logging-in-a-custom-jupyter-kernel/ ✔ [200] https://blog.alexwendland.com/2010-06-25--day-6/ ✔ [200] http://www.google.com/schemas/sitemap-news/0.9 ✔ [200] https://blog.alexwendland.com/ ✗ [404] https://blog.alexwendland.com/notes-gender-diversity/ | Failed: Network error: Not Found ✔ [200] https://blog.alexwendland.com/2020-06-19-how-to-implement-max-download-size-with-got/ ✔ [200] https://blog.alexwendland.com/2020-06-09-release-bedsheets/ ✔ [200] https://blog.alexwendland.com/2013-07-27-robotics-subject-thats-lacking/ ✔ [200] https://blog.alexwendland.com/2020-07-06-using-filetype-to-guess-chk-files-in-found-000/ ✔ [200] https://blog.alexwendland.com/2020-04-10-senior-thesis/ ✔ [200] https://blog.alexwendland.com/2018-06-08-yarn-vs-npm/ ✔ [200] https://blog.alexwendland.com/2014-03-28-android-the-better-ux/ ✔ [200] https://blog.alexwendland.com/2013-07-09-why-start-a-blog/ ✔ [200] https://blog.alexwendland.com/notes-healthcare/ ✔ [200] https://blog.alexwendland.com/2015-05-13-the-second-quarter-of-2015-items/ ✔ [200] https://blog.alexwendland.com/notes-big-trees/ ✔ [200] https://blog.alexwendland.com/2020-11-17-extract-color-configurations-from-an-iterm-profile/ ✔ [200] http://www.sitemaps.org/schemas/sitemap/0.9 Issues found in 1 input. Find details below. [prev-sitemap.xml]: ✗ [404] https://blog.alexwendland.com/notes-gender-diversity/ | Failed: Network error: Not Found ✗ [404] http://www.google.com/schemas/sitemap-mobile/1.0 | Failed: Network error: Not Found ```

[awendland]

With e680379 I believe that all previous functionality has been migrated to Hugo. Hallelujah!