Bump deps (auth, orquesta, lint/test, etc) to support newer python

[cognifloyd]

This PR is easiest to review per-commit.

A couple of commits were cherry-picked from #6236. I updated some things farther than #6236 did, so I didn't include the commits that updated those deps. I believe that covers all of the the requirements changes from #6236 except the switch from nose to pytest.

This makes a variety of requirements updates, especially orquesta and deps on lint/test tooling.

• Use st2-auth-backend-flatfile recently released to pypi: https://pypi.org/project/st2-auth-backend-flat-file/0.3.0/
• Bump orquesta and related packages to latest orquesta commit to pull in python compat updates
• Use the latest version of st2flake8 as it supports flake8 7.0.0: https://pypi.org/project/st2flake8/0.2.0/
• Drop the MarkupSafe constraint. Jinja2 v3+ has fixed their usage of MarkupSafe to support MarkupSafe 2.1+
• Remove lockfiles/pytest.lock and just have pants use lockfiles/st2.lock when running pytest.
• Bump bandit

Regenerated Lockfile Summaries

lockfiles/bandit.lock

==                    Upgraded dependencies                     ==

  bandit                         1.7.0        -->   1.7.10
  gitpython                      3.1.18       -->   3.1.43
  pbr                            6.0.0        -->   6.1.0
  pyyaml                         6.0.1        -->   6.0.2
  setuptools                     69.2.0       -->   75.2.0
  stevedore                      5.2.0        -->   5.3.0

==                      Added dependencies                      ==

  markdown-it-py                 3.0.0
  mdurl                          0.1.2
  pygments                       2.18.0
  rich                           13.9.3
  typing-extensions              4.12.2

==                     Removed dependencies                     ==

  six                            1.16.0

lockfiles/flake8.lock

==                    Upgraded dependencies                     ==

  flake8                         4.0.1        -->   7.0.0
  flake8-copyright               0.2.2        -->   0.2.4
  mccabe                         0.6.1        -->   0.7.0
  pycodestyle                    2.8.0        -->   2.11.1
  pyflakes                       2.4.0        -->   3.2.0
  setuptools                     69.2.0       -->   75.2.0
  st2flake8                      0.1.0        -->   0.2.0

==                     Removed dependencies                     ==

  flake8-polyfill                1.0.2

lockfiles/pytest.lock

Removed - merged with lockfiles/st2.lock. (see below)

lockfiles/st2.lock

st2-auth-ldap was also updated to a later commit, but it doesn't show in the lockfile diff output.

==                !! Downgraded dependencies !!                 ==

  pytest                         8.3.3        -->   7.0.1

==                    Upgraded dependencies                     ==

  chardet                        3.0.4        -->   5.2.0
  flask                          2.1.3        -->   3.0.3
  markupsafe                     2.0.1        -->   2.1.5
  networkx                       2.8.8        -->   3.1
  orjson                         3.10.7       -->   3.10.10
  redis                          5.1.1        -->   5.2.0
  st2-auth-backend-flat-file     0.2.0        -->   0.3.0
  webob                          1.8.8        -->   1.8.9
  werkzeug                       2.1.2        -->   3.0.4

==                      Added dependencies                      ==

  blinker                        1.8.2
  coverage                       7.4.4
  execnet                        2.1.1
  icdiff                         2.0.7
  pprintpp                       0.4.0
  py                             1.11.0
  py-cpuinfo                     9.0.0
  pygal                          3.0.5
  pygaljs                        1.0.2
  pytest-benchmark               3.4.1
  pytest-cov                     3.0.0
  pytest-forked                  1.6.0
  pytest-icdiff                  0.9
  pytest-xdist                   2.5.0

==                     Removed dependencies                     ==

  exceptiongroup                 1.2.2