search

slaclab / slactwin

Other
2 stars 0 forks source link

mock live changes not added to db on sirepo-alpha #58

Closed e-carlin closed 4 days ago

e-carlin commented 1 week ago

I'm running slactwin mock live on sirepo-alpha and new files are not being picked up and added to the db.

e-carlin commented 1 week ago

I'm running slactwin mock live and slactwin service db in different containers. When a file is created in the summary_dir in the slactwin mock live container then the slactwin service db container doesn't pickup the change. In addition, when I touch a file in the summary_dir directly on iana then slactwin service db still doesn't pick up the change

Running on a dev machine with each service running in a separate docker container I see updates. So, there is something unique about the interplay of watch dog and the s3df filesystem (maybe kubernetes too?).

e-carlin commented 1 week ago

Under the covers watchdog.obervers.Observer is using inotify. My guess is that across hosts with different kernels this is not working. I think we should switch to watchdog.observers.polling.

I'm going to write a test to confirm.

robnagler commented 6 days ago

I think me may want to limit the polls to a specific day summary directory. This will make this tolerable. The code needs to change the directory daily.