thegetty / quire

A multi-package repository for the Quire multiformat publishing framework
https://quire.getty.edu/
BSD 3-Clause "New" or "Revised" License
94 stars 12 forks source link

Large projects run out of node memory and can't preview or build #748

Open geealbers opened 1 year ago

geealbers commented 1 year ago

Before proceeding, check to make sure there isn’t an existing issue for this bug.

Steps to reproduce

  1. Start with a project that has a lot of Markdown files and/or large images. Like this one with 500 markdown files: test-size-limit.zip

  2. Install the project dependencies (npm install) and then run quire preview

Actual behavior

The preview process stops before completing, with this error:

FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory

Expected behavior

The preview process should carry on and a preview site should display at http://localhost:8080/.

Version numbers

macOS Ventura 13.2.1 Node 18.16.0 Quire CLI 1.0.0-rc.7

What browsers are you seeing the problem on?

No response

Relevant Terminal/Shell output

No response

Supporting Information

See Discussion #742 for some more details.

See also the info we have posted in the Troubleshooting Quire docs to help users increase memory allocated to Node: https://quire.getty.edu/docs-v1/troubleshooting/#working-with-very-large-projects.

hbalenda commented 1 year ago

See: https://jira.getty.edu/browse/DEV-15444

Erin-Cecele commented 1 year ago

@rrolonNelson Thank you for bringing this to our attention in Discussion #742. We have opened this issue and discussed it with the core Quire team. For now, we are backlogging it while we dig deeper into the root cause and potential solutions. It's also worth noting that it seems to be related to other 11ty performance issues, especially this bug (#2226). Please stay tuned for updates.