ocean-data-factory-sweden / kso

Notebooks to upload/download marine footage, connect to a citizen science project, train machine learning models and publish marine biological observations.
GNU General Public License v3.0
4 stars 12 forks source link

Permission denied when initiating the projectprocessor #410

Closed donkyjohn closed 2 weeks ago

donkyjohn commented 1 month ago

🐛 Bug

A clear and concise description of what the bug is. I run into a permission error: PermissionError: [Errno 13] Permission denied: '[/mimer]

To Reproduce (REQUIRED)

Input:

I'm running into this issue when i'm trying to run the process_aggregations notebook. 

Output:

INFO:root:Koster_Seafloor_Obs loaded succesfully
INFO:root:Running locally, no external connection to server needed.
---------------------------------------------------------------------------
FileNotFoundError                         Traceback (most recent call last)
File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:

FileNotFoundError: [Errno 2] No such file or directory: '[/mimer/NOBACKUP/groups/snic2021-6-9/db_starter/csv_Koster_Seafloor_Obs](https://album.cloudina.org/mimer/NOBACKUP/groups/snic2021-6-9/db_starter/csv_Koster_Seafloor_Obs)'

During handling of the above exception, another exception occurred:

FileNotFoundError                         Traceback (most recent call last)
File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:

FileNotFoundError: [Errno 2] No such file or directory: '[/mimer/NOBACKUP/groups/snic2021-6-9/db_starter](https://album.cloudina.org/mimer/NOBACKUP/groups/snic2021-6-9/db_starter)'

During handling of the above exception, another exception occurred:

FileNotFoundError                         Traceback (most recent call last)
File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:

FileNotFoundError: [Errno 2] No such file or directory: '[/mimer/NOBACKUP/groups/snic2021-6-9](https://album.cloudina.org/mimer/NOBACKUP/groups/snic2021-6-9)'

During handling of the above exception, another exception occurred:

FileNotFoundError                         Traceback (most recent call last)
File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:

FileNotFoundError: [Errno 2] No such file or directory: '[/mimer/NOBACKUP/groups](https://album.cloudina.org/mimer/NOBACKUP/groups)'

During handling of the above exception, another exception occurred:

FileNotFoundError                         Traceback (most recent call last)
File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:

FileNotFoundError: [Errno 2] No such file or directory: '[/mimer/NOBACKUP](https://album.cloudina.org/mimer/NOBACKUP)'

During handling of the above exception, another exception occurred:

PermissionError                           Traceback (most recent call last)
Cell In[4], line 5
      2 project = p_utils.find_project(project_name=project_name.value)
      4 # Initiate pp
----> 5 pp = ProjectProcessor(project)

File [~/.local/lib/python3.10/site-packages/kso_utils/project.py:58](https://album.cloudina.org/user/kso-benjamin/~/.local/lib/python3.10/site-packages/kso_utils/project.py#line=57), in ProjectProcessor.__init__(self, project)
     55 self.connect_to_server()
     57 # Map initial csv files
---> 58 self.map_init_csv()
     60 # Create empty db and populate with local csv files data
     61 self.setup_db()

File [~/.local/lib/python3.10/site-packages/kso_utils/project.py:95](https://album.cloudina.org/user/kso-benjamin/~/.local/lib/python3.10/site-packages/kso_utils/project.py#line=94), in ProjectProcessor.map_init_csv(self)
     93 # Create the folder to store the csv files if not exist
     94 if not Path(self.project.csv_folder).exists():
---> 95     Path(self.project.csv_folder).mkdir(parents=True, exist_ok=True)
     97     # Recursively add permissions to folders created
     98     for root, dirs, files in Path(self.project.csv_folder).iterdir():

File [/opt/tljh/user/lib/python3.10/pathlib.py:1179](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1178), in Path.mkdir(self, mode, parents, exist_ok)
   1177     if not parents or self.parent == self:
   1178         raise
-> 1179     self.parent.mkdir(parents=True, exist_ok=True)
   1180     self.mkdir(mode, parents=False, exist_ok=exist_ok)
   1181 except OSError:
   1182     # Cannot rely on checking for EEXIST, since the operating system
   1183     # could give priority to other errors like EACCES or EROFS

File [/opt/tljh/user/lib/python3.10/pathlib.py:1179](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1178), in Path.mkdir(self, mode, parents, exist_ok)
   1177     if not parents or self.parent == self:
   1178         raise
-> 1179     self.parent.mkdir(parents=True, exist_ok=True)
   1180     self.mkdir(mode, parents=False, exist_ok=exist_ok)
   1181 except OSError:
   1182     # Cannot rely on checking for EEXIST, since the operating system
   1183     # could give priority to other errors like EACCES or EROFS

    [... skipping similar frames: Path.mkdir at line 1179 (2 times)]

File [/opt/tljh/user/lib/python3.10/pathlib.py:1179](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1178), in Path.mkdir(self, mode, parents, exist_ok)
   1177     if not parents or self.parent == self:
   1178         raise
-> 1179     self.parent.mkdir(parents=True, exist_ok=True)
   1180     self.mkdir(mode, parents=False, exist_ok=exist_ok)
   1181 except OSError:
   1182     # Cannot rely on checking for EEXIST, since the operating system
   1183     # could give priority to other errors like EACCES or EROFS

File [/opt/tljh/user/lib/python3.10/pathlib.py:1175](https://album.cloudina.org/opt/tljh/user/lib/python3.10/pathlib.py#line=1174), in Path.mkdir(self, mode, parents, exist_ok)
   1171 """
   1172 Create a new directory at this given path.
   1173 """
   1174 try:
-> 1175     self._accessor.mkdir(self, mode)
   1176 except FileNotFoundError:
   1177     if not parents or self.parent == self:

PermissionError: [Errno 13] Permission denied: '[/mimer](https://album.cloudina.org/mimer)'

Expected behavior

A clear and concise description of what you expected to happen.

Environment

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.

jannesgg commented 4 weeks ago

@donkyjohn I think this has been fixed recently, do a git pull and let me know if the issue still persists.