search

skinkie / reference

Personal repository where I collect working examples to understand inner workings while building PyNeTExConv
GNU Affero General Public License v3.0
1 stars 1 forks source link

In the datapipeline: the existence of files needs to be checked, if they are to be read. #51

Closed ue71603 closed 3 months ago

skinkie commented 3 months ago

Can you elaborate?

ue71603 commented 3 months ago

One of the errors that I had was when I tried to laod a duckdb that did not exist. This did not result in a "file not found", but in an error when the generator returned none. So it was unclear that this resultated from a missing file and not some missing data in the file.

skinkie commented 3 months ago

Oh right, because a non-existing file would mean create the file. I think it would also be a best practise to open it for read only (I thought I already implemented that).

ue71603 commented 3 months ago

yes. it is onl a problem for the db that should contain the data.

ue71603 commented 3 months ago

if you did, then close the issue.

skinkie commented 3 months ago

I'll explicitly add something. I think I would like to integrate #45 in this process. To make the database access as transparant as possible.

ue71603 commented 3 months ago

you are the developer :-)