helseprofil / orgdata

:package: R package for aggregating original data mostly on enumeration areas level of granularity
https://helseprofil.github.io/orgdata/
Other
1 stars 0 forks source link

"Valid to" (IBRUKTIL) date for Raw file: A date in the future, but close, makes the file Not valid. #272

Closed raniets closed 2 years ago

raniets commented 2 years ago

I replaced an old Raw file with a new. During checking the new file, I wanted to run the old file again to get a log file, and set the IBRUKTIL date for the old file to a date a few days later than today (IBRUKTIL = 19.06.2022, today = 16.06.2022). Repeated attempts to run it using KOBLID [ make_file("BEF_GKny", koblid = 288) ] stopped with message "Error: No valid file found!". Then, I set the IBRUKTIL to 01.01.9999, and the file was processed giving only the normal messages.

ybkamaleri commented 2 years ago

Unfortunately we just use a pragmatic approach in SQL syntax to filter active files ONLY by those that have IBRUKTIL 01.01.9999. It's not exactly a date to compare against current date. Therefore all "dates" other than 01.01.9999 will be invalid. 😢 But we could of course do it differently if it's a feature that is needed and necessary to do the work. @raniets