nf-osi / jobs

0 stars 0 forks source link

Test registering webhooks for a job #88

Closed anngvu closed 1 month ago

anngvu commented 2 months ago

It looks like webhooks is being implemented on the platform services backend. We can test if we can use it to watch a folder to trigger some job. Note that we will run into a limit of how many webhooks we can register with a single service account -- where https://github.com/Sage-Bionetworks/Synapse-Repository-Services/pull/5140/files#diff-4173738b125392fbcb658c121ee2ad3a1338a7b8e9256d4ff4a88eccdf4669a2R84 suggests we get 25 registrations, so would have to prioritize unless manual override is granted.

Update: This required setting up resources on AWS given the limited whitelisted endpoints this feature will work with.