Is your feature request related to a problem? Please describe
When having a few thousand markdown pages (2,000+), navigating between markdown pages when running the dev server can take seconds to load the new page.
(I observed multiple seconds on an Intel MacBook Pro and 1~2 seconds on a M1 Pro MacBook Pro per page transition.)
This problem explicitly occurs on the local dev server, for markdown pages only, and only when having 2,000+ markdown pages, making local development quite frustrating.
Build times are fine though and navigating on the SSR generated site is snappy.
I assume not using the cache keeps hot reload working when files are changed, however this seems to cause the severe degradation in performance when dealing with lots of markdown pages.
To fix the issue I suggest using the cache on localhost as well, and flushing the cache when a file change is detected, to keep hot reload working.
I will create a PR (draft) later to address this.
Is your feature request related to a problem? Please describe
When having a few thousand markdown pages (2,000+), navigating between markdown pages when running the dev server can take seconds to load the new page. (I observed multiple seconds on an Intel MacBook Pro and 1~2 seconds on a M1 Pro MacBook Pro per page transition.)
This problem explicitly occurs on the local dev server, for markdown pages only, and only when having 2,000+ markdown pages, making local development quite frustrating. Build times are fine though and navigating on the SSR generated site is snappy.
Describe the solution you'd like
The problem seems to be caused by not using the content cache on localhost. https://github.com/nuxt/content/blob/3a2b5d1ec19f9232dd9f5b3487c93ff3997c7476/src/runtime/server/storage.ts#L147-L149
I assume not using the cache keeps hot reload working when files are changed, however this seems to cause the severe degradation in performance when dealing with lots of markdown pages.
To fix the issue I suggest using the cache on localhost as well, and flushing the cache when a file change is detected, to keep hot reload working. I will create a PR (draft) later to address this.
Describe alternatives you've considered
N/A
Additional context
Video showing the issue:
https://github.com/nuxt/content/assets/7602082/7582f494-1fd4-43b2-aaac-8ebc1dd8c7a6
On the video loading times are still < 1s, however the situation gets worse for more complex markdown pages.
Video showing the fix I'm working on:
https://github.com/nuxt/content/assets/7602082/15f27e2a-6923-4cfd-8581-62e831065fb8
Reproduction
I've created a project on StackBlitz to reproduce the issue. https://stackblitz.com/~/github.com/coffeephile/nuxt-huge-project-test
nuxt-content-performance-patchnpm iNUXT_NUM_PAGES=10000 npm run dev(generate 10,000 markdown pages)To apply the fix:
chmod +x patch-content-localhost.sh./patch-content-localhost.shNUXT_NUM_PAGES=10000 npm run dev