Worker construction only works with relative paths

Describe the bug

When using the new Worker(new URL() web worker construction, using a relative path (i.e. ./worker.js) will result in the worker being found just fine, but using an absolute path (i.e. /worker.js) will result in an error Failed to fetch a worker script., even if both resulted URLs point to the same file. I expect that because the two should resolve to the same file that it would work either way, especially as there is no documentation stating otherwise, but they appear to have different behavior.

Reproduction

https://stackblitz.com/edit/vitejs-vite-oguzf8?file=main.js,worker1.js,worker2.js,package-lock.json&terminal=dev

System Info

System:
    OS: macOS 12.6
    CPU: (10) arm64 Apple M1 Max
    Memory: 10.19 GB / 64.00 GB
    Shell: 5.8.1 - /bin/zsh
  Binaries:
    Node: 16.17.0 - ~/.volta/tools/image/node/16.17.0/bin/node
    npm: 8.15.0 - ~/.volta/tools/image/node/16.17.0/bin/npm
  Browsers:
    Chrome: 105.0.5195.125
    Safari: 16.0
  npmPackages:
    vite: ^3.1.0 => 3.1.3

Used Package Manager

npm

Logs

No response

Validations

[X] Follow our Code of Conduct
[X] Read the Contributing Guidelines.
[X] Read the docs.
[X] Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
[X] Make sure this is a Vite issue and not a framework-specific issue. For example, if it's a Vue SFC related bug, it should likely be reported to vuejs/core instead.
[X] Check that this is a concrete bug. For Q&A open a GitHub Discussion or join our Discord Chat Server.
[X] The provided reproduction is a minimal reproducible example of the bug.

vitejs / vite