Migrate from `setup.py` to `pyproject.toml` using PDM

[rugeli]

Use Case

As we integrate more closely with AWS services and frontend work, using modern packaging standards will benefit our development workflow and simplify dependency management

Solution

Please describe your ideal solution

• install Poetry we decided to use pyenv +pdm after discussion
• create a pyproject.toml file
• update github action workflows to use Poetry commands
• update Dockerfile (if it's merged into main)
• update README

[mogres]

Thanks for adding this issue! It would be an excellent update for dependency management for this project. Adding some thoughts here for discussion:

Another alternative to poetry is PDM, which we have used for package management in other projects. Either would work for our use case.

One more thing to consider with this change would be to move away from third party conda virtual environments and stick to native solutions like venv. Note that this will require using pyenv to manage python versions.