cityofaustin / atd-data-tech

Austin Transportation Data & Technology Services
17 stars 2 forks source link

[Enhancement] Enhance Zappa deployment tooling and testing #15480

Open patrickm02L opened 5 months ago

patrickm02L commented 5 months ago

Description:

The current Zappa deployment process is fragile and difficult to test locally. This work will make the Zappa deployment more robust and help prevent future deployment issues. It will also get us in the habit of more regularly merging dependent bot updates.

@mddilley @frankhereford would you please help articulate these requirements

mddilley commented 5 months ago

@frankhereford I added some steps above, but they could definitely use another pass. I also noticed that the GH workflow sneakily recycles the requirements.txt from the Flask app to install zappa before deployment. Makes total sense how none of us noticed that removing removing that dependency would derail the deployment workflow! 🙃

frankhereford commented 5 months ago

@mddilley I think the three items you added in the checkbox list make a lot of sense and are certainly in scope of this issue. I don't have any ideas right not to add, but I think that's a reflection on my lack of experience with zappa and lambda more broadly. If I am able to help work on this issue, getting that experience is going to be really valuable to me. Thanks again, and I'll come back and add anything that comes to mind. 🙏

johnclary commented 5 months ago

We are thinking that we can minimize the scope of this by borrowing from a similar Moped github action to bring the deployment up to support a more current version of Python.

johnclary commented 2 weeks ago

I am going to move this into the icebox in favor moving the whole API from lambda to ECS: https://github.com/cityofaustin/atd-data-tech/issues/18154