I needed to add PUPPETEER_SKIP_DOWNLOAD=true to the .npmrc. Maybe you want to add to the documentation that this might be needed in ci environments?
2023-06-09 09:32:19,231 - xmake-core - ERROR - ERROR: Failed to set up Chrome r113.0.5672.63! Set "PUPPETEER_SKIP_DOWNLOAD" env variable to skip download.