Windows Store installer should warn user about MAX_PATH

[e40616bc-568a-48a9-842c-aa69a6f69150]

BPO	37769
Nosy	@pfmoore, @ncoghlan, @tjguk, @zware, @eryksun, @zooba, @dstufft, @pradyunsg
PRs	python/cpython#15914

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields: ```python assignee = None closed_at = None created_at = labels = ['type-feature', '3.10', 'OS-windows'] title = 'Windows Store installer should warn user about MAX_PATH' updated_at = user = 'https://bugs.python.org/JonasBinding' ``` bugs.python.org fields: ```python activity = actor = 'eryksun' assignee = 'none' closed = False closed_date = None closer = None components = ['Windows'] creation = creator = 'Jonas Binding' dependencies = [] files = [] hgrepos = [] issue_num = 37769 keywords = ['patch'] message_count = 5.0 messages = ['349079', '349083', '349086', '349087', '351811'] nosy_count = 10.0 nosy_names = ['paul.moore', 'ncoghlan', 'tim.golden', 'zach.ware', 'eryksun', 'steve.dower', 'dstufft', 'pradyunsg', 'Marcus.Smith', 'Jonas Binding'] pr_nums = ['15914'] priority = 'normal' resolution = None stage = None status = 'open' superseder = None type = 'enhancement' url = 'https://bugs.python.org/issue37769' versions = ['Python 3.10'] ```

[e40616bc-568a-48a9-842c-aa69a6f69150]

The "Windows Store" installer for Python has a seemingly low entry barrier, causing people to install without reading something like https://docs.python.org/3.7/using/windows.html.

However, due to the really long path it uses for Python (e.g. C:\Users\USERNAME\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\), the chances of running into issues with paths longer than 260 characters are really high.

For example installing pytorch already fails due to this limitation, see https://github.com/pytorch/pytorch/issues/23823 and https://www.reddit.com/r/pytorch/comments/c6cllq/issue_installing_pytorch/

Therefore, the Windows Store installer should offer to change the registry key to enable longer paths, or at least show a message to this effect.

[zooba]

Short of adding a popup into Python itself the first time you run it (and would that include if you run "pip" first?), we don't have any ability to extend the installer.

We could reduce the "local-packages/Python37/site-packages" part of the path by implementing an alternative way (in both Python and pip, presumably) to specify the user's site packages. Right now, the best I can do is reduce "local-packages" down to a single character (in PC/python_uwp.cpp ) - the rest is forcibly added by the shared part of the runtime.

Since pip is likely to be the first place users hit this, it might be easiest to start by adding a more descriptive error message. Copying from the other bug:

pip3 install https://download.pytorch.org/whl/cpu/torch-1.1.0-cp37-cp37m-win_amd64.whl fails with an error message:

ERROR: Could not install packages due to an EnvironmentError: [Errno 2] No such file or directory: 'C:\\Users\\[username]\\AppData\\Local\\Packages\\PythonSoftwareFoundation.Python.3.7_qbz5n2kfra8p0\\LocalCache\\local-packages\\Python37\\site-packages\\caffe2\\python\\serialized_test\\data\\operator_test\\collect_and_distribute_fpn_rpn_proposals_op_test.test_collect_and_dist.zip'

First it seems the error is being raised incorrectly - winerror 2 is for file not found, but it's being passed as errno 2. But otherwise it should be possible to detect this case, see that the path is too long on Windows and point users at https://docs.python.org/3/using/windows.html#removing-the-max-path-limitation

[eryksun]

First it seems the error is being raised incorrectly - winerror 2 is for file not found, but it's being passed as errno 2.

I think this only happens with open(). The _io module could use the CRT's _doserrno value to call PyErr_SetExcFromWindowsErrWithFilenameObject. We can rely on _doserrno if _wopen fails.

Otherwise this is the expected mapping from Windows ERROR_PATH_NOT_FOUND (3) or ERROR_FILENAME_EXCED_RANGE (206) to POSIX ENOENT (2). The Windows error in the case of path that's too long is not ERROR_FILE_NOT_FOUND (2).

[eryksun]

I think this only happens with open().

Well, and everything else that calls a CRT function and relies on errno, such as C read() and write(). Though we'd have to look through on a case-by-case basis to ensure that _doserrno is valid in each case, i.e. that errno was set based on a Windows error code.

[zooba]

I don't know that it's a great idea, but I did PR 15914 just to see how an additional message on OSError would look.