search

tlofreso / bulletin

0 stars 1 forks source link

Quantity Cap #11

Open mfgarvin opened 6 months ago

mfgarvin commented 6 months ago

Looks like DM has a cap at how many PDFs can be viewed per day. Perhaps in the 20-25 range? Could be more. Will have to add logic to stay within this limit.

Upon downloading past the cap, the user receives this message: "Maximum number of files downloaded today."

PyPDF2 sees this as a missing EOF marker

tlofreso commented 6 months ago

Do you have a sense of how many Cleveland Diocese bulletins Discover Mass hosts? We could use something like AWS API gateway. The total # of calls would fall well within the free tier, but data transfer $ would likely hit.

If the number of bulletins is low enough, we could probably path through something I host.

mfgarvin commented 6 months ago

Looks like around 35 or so parishes use Discover Mass, so it shouldn't be too complicated to stay within their free tier restrictions. Could actually just be as simple as running the script twice, and hoping that the ip of the GitHub Action instance changes.