rd-ukc-sc / amapola-distributions

Public repository for hosting built Amapola binary distributions
0 stars 0 forks source link

Windows file system issues #2

Closed movpasd closed 10 months ago

movpasd commented 10 months ago

Read-only files break shutil and when file paths are too long.

movpasd commented 10 months ago

Analysis & plan of attack

(For this and #1)

1 occurs when trying to read extracted ZIPs, #2 occurs when attempting to clean up files

What are the errors occuring?

File system refactor:

movpasd commented 10 months ago

AB27/096032 FileNotFoundError

[ERROR] root -- 2023-12-14 11:44:38 tid25264
[WinError 3] The system cannot find the path specified: 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp8AB27-096032-rev0\\extracted\\FOPA-BT-22278-000C-ORANGE FTTH-1.zip\\FOPA-BT-22278-000C-ORANGE FTTH-1\\FOPA-BT-22278-000C-ORANGE FTTH-1\\FOPA-BT-22278-000C-ORANGE FTTH_RueHenriBecquerel-1\\FOPA-BT-22278-000C-ORANGE FTTH-1_Photos'
Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\controller.py", line 371, in process_case
    warnings = self._diff_identifier.apply_diff(diff.casenumber)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\sync.py", line 237, in apply_diff
    (_, download, other_objs), ws = c.create_case(
                                    ^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 170, in create_case
    pcm_paths, retr_warnings = self.pcm_retriever.retrieve(into=workdir)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 302, in retrieve
    dled_pcm_paths = _search_for_pcms(extracted_dir)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 507, in _search_for_pcms
    return list(dir.glob("**/*.[pP][cC][mM]"))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\pathlib.py", line 953, in glob
    for p in selector.select_from(self):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\pathlib.py", line 408, in _select_from
    for p in successor_select(starting_point, is_dir, exists, scandir):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\pathlib.py", line 355, in _select_from
    with scandir(parent_path) as scandir_it:
         ^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\pathlib.py", line 938, in _scandir
    return os.scandir(self)
           ^^^^^^^^^^^^^^^^
FileNotFoundError: [WinError 3] The system cannot find the path specified: 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp8AB27-096032-rev0\\extracted\\FOPA-BT-22278-000C-ORANGE FTTH-1.zip\\FOPA-BT-22278-000C-ORANGE FTTH-1\\FOPA-BT-22278-000C-ORANGE FTTH-1\\FOPA-BT-22278-000C-ORANGE FTTH_RueHenriBecquerel-1\\FOPA-BT-22278-000C-ORANGE FTTH-1_Photos'
movpasd commented 10 months ago

AB27/126453 shutil.Error

[ERROR] root -- 2023-12-14 11:45:17 tid25080
[('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG'")]
Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 825, in move
    os.rename(src, real_dst)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete' -> 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\controller.py", line 371, in process_case
    warnings = self._diff_identifier.apply_diff(diff.casenumber)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\sync.py", line 237, in apply_diff
    (_, download, other_objs), ws = c.create_case(
                                    ^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 170, in create_case
    pcm_paths, retr_warnings = self.pcm_retriever.retrieve(into=workdir)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 299, in retrieve
    new_ws = _dezip_and_move_all(within=casefiles_dir, into=extracted_dir)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 481, in _dezip_and_move_all
    deep_extract(
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\archivecrawler\__init__.py", line 91, in deep_extract
    shutil.move(completedir, target)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 841, in move
    copytree(src, real_dst, copy_function=copy_function,
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 561, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 515, in _copytree
    raise Error(errors)
shutil.Error: [('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1.JPG'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1.PCM'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportComac.xlsx'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_ExportPdf.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Photos'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1_Plan.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpfutvn256\\complete\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp10AB27-126453-rev0\\extracted\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp10AB27-126453-rev0\\\\extracted\\\\FOPA-BT-22372--000L-ORANGE-FTTH-Partie4-1.zip\\\\FOPA-BT-22372- 000L-ORANGE FTTH_Partie4-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RueEdouardQuemper-1\\\\FOPA-BT-22372- 000L-ORANGE FTTH_RUEEDOUARDQUEMPER-1_SIG'")]

Decent likelihood that this is also a path length issue, as some of the path lengths here are greater than 260.

movpasd commented 10 months ago

AB27/146963 PermissionError

[WinError 5] Access is denied: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpzfzjudc_\\complete\\15-BREBANT'
Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 825, in move
    os.rename(src, real_dst)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpzfzjudc_\\complete' -> 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp705AB27-146963-rev0\\extracted\\15-BREBANT.zip'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\controller.py", line 371, in process_case
    warnings = self._diff_identifier.apply_diff(diff.casenumber)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\sync.py", line 237, in apply_diff
    (_, download, other_objs), ws = c.create_case(
                                    ^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 170, in create_case
    pcm_paths, retr_warnings = self.pcm_retriever.retrieve(into=workdir)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 299, in retrieve
    new_ws = _dezip_and_move_all(within=casefiles_dir, into=extracted_dir)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 481, in _dezip_and_move_all
    deep_extract(
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\archivecrawler\__init__.py", line 91, in deep_extract
    shutil.move(completedir, target)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 843, in move
    rmtree(src)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 759, in rmtree
    return _rmtree_unsafe(path, onerror)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 617, in _rmtree_unsafe
    _rmtree_unsafe(fullname, onerror)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 626, in _rmtree_unsafe
    onerror(os.rmdir, path, sys.exc_info())
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 624, in _rmtree_unsafe
    os.rmdir(path)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpzfzjudc_\\complete\\15-BREBANT'

Decent chance that this is caused by the read-only files, as it happens on cleanup.

movpasd commented 10 months ago

AB27/075761 OSError

[ERROR] root -- 2023-12-14 12:55:57 tid10808
[WinError 145] The directory is not empty: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3_SIG'
Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 825, in move
    os.rename(src, real_dst)
PermissionError: [WinError 5] Access is denied: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete' -> 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\archivecrawler\__init__.py", line 91, in deep_extract
    shutil.move(completedir, target)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 841, in move
    copytree(src, real_dst, copy_function=copy_function,
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 561, in copytree
    return _copytree(entries=entries, src=src, dst=dst, symlinks=symlinks,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 515, in _copytree
    raise Error(errors)
shutil.Error: [('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3.JPG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3.JPG', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3.JPG'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3.PCM', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3.PCM', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3.PCM'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportComac.xlsx', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportComac.xlsx', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportComac.xlsx'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportPdf.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportPdf.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_ExportPdf.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Photos', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Photos', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Photos'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Plan.pdf', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Plan.pdf', "[Errno 2] No such file or directory: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3_Plan.pdf'"), ('C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3_SIG', 'C:\\Users\\Public\\Applications\\Amapola\\tmp\\tmp1167AB27-075761-rev0\\extracted\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3_SIG', "[WinError 3] The system cannot find the path specified: 'C:\\\\Users\\\\Public\\\\Applications\\\\Amapola\\\\tmp\\\\tmp1167AB27-075761-rev0\\\\extracted\\\\FOPA-BT-22070-001P-ORANGE-FTTH-AB27-075761-2.zip\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3_SIG'")]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\concurrent\futures\thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\controller.py", line 371, in process_case
    warnings = self._diff_identifier.apply_diff(diff.casenumber)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\sync.py", line 237, in apply_diff
    (_, download, other_objs), ws = c.create_case(
                                    ^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 170, in create_case
    pcm_paths, retr_warnings = self.pcm_retriever.retrieve(into=workdir)
                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 299, in retrieve
    new_ws = _dezip_and_move_all(within=casefiles_dir, into=extracted_dir)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\amapolaapp\db\createcase.py", line 481, in _dezip_and_move_all
    deep_extract(
  File "C:\Users\Yan001n\repos\rd-ukc-sc\amapola\src\archivecrawler\__init__.py", line 67, in deep_extract
    with TemporaryDirectory() as tmpdirstr:
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\tempfile.py", line 904, in __exit__
    self.cleanup()
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\tempfile.py", line 908, in cleanup
    self._rmtree(self.name, ignore_errors=self._ignore_cleanup_errors)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\tempfile.py", line 890, in _rmtree
    _shutil.rmtree(name, onerror=onerror)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 759, in rmtree
    return _rmtree_unsafe(path, onerror)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 617, in _rmtree_unsafe
    _rmtree_unsafe(fullname, onerror)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 617, in _rmtree_unsafe
    _rmtree_unsafe(fullname, onerror)
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 617, in _rmtree_unsafe
    _rmtree_unsafe(fullname, onerror)
  [Previous line repeated 1 more time]
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 626, in _rmtree_unsafe
    onerror(os.rmdir, path, sys.exc_info())
  File "C:\Users\Yan001n\.pyenv\pyenv-win\versions\3.11.4\Lib\shutil.py", line 624, in _rmtree_unsafe
    os.rmdir(path)
OSError: [WinError 145] The directory is not empty: 'C:\\Users\\Yan001n\\AppData\\Local\\Temp\\tmpie7vtesg\\complete\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_Rue Saint Sebastian3\\FOPA-BT-22070-001P-ORANGE FTTH-AB27_075761-2_RUE SAINT SEBASTIAN3_SIG'

Why is this using tempdir instead of the amapolaapp replacement? Another issue should be opened for refactoring this function to use a provided working directory instead of generating its own tempdir.

No matter for this issue though -- the fundamental issue is the usage of shutil.move again. shutil fails to find a file which is meant to be moved. tempdir then attempts to clean this up but fails to do so because it also uses shutil.

movpasd commented 10 months ago

In the end, to circumvent the path length issue, I wrote a replacement for pathlib.Path which uses the Windows long-path prefix

movpasd commented 10 months ago

This should now be fixed, we just need to be on the lookout for more OSErrors, FileNotFoundErrors, etc