search

AllenNeuralDynamics / aind-watchdog-service

Data staging service that prepares acquistion data for cloud upload to Amazon S3 and Code Ocean processing.
https://allenneuraldynamics.github.io/aind-watchdog-service/
MIT License
2 stars 0 forks source link

Duplicate jobs submitted in a short period of time #27

Closed hanhou closed 3 weeks ago

hanhou commented 3 months ago

Describe the bug The watchdog submits two or three jobs at once when there is only one change in the yml file.

To Reproduce Steps to reproduce the behavior:

  1. Start the watchdog by "Run Without Debugging" the main.py on develop branch.
  2. Copy and paste a yml file to flag_dir, or if it already exists, make a change to it and save.
  3. The watchdog detects the change and submits two or three jobs at once.

Expected behavior Only submit one job per (change of) yml file.

Screenshots Example log file aind-watchdog-service.log

An example case where 3 jobs are submitted within ~300 ms: image

Desktop (please complete the following information):

arielleleon commented 1 month ago

@hanhou I know what is going on here and I commented on it in this ticket

hanhou commented 1 month ago

Makes sense! That's interesting. I think this could be of low priority since we don't use text editor in production.

arielleleon commented 1 month ago

@hanhou This has been fixed in the latest development release. I will coordinate with Alex to test and once we think this is good, I will have you close this issue