Multi progbar backend

[mkolopanis]

Adds tqdm progress bar as a backend option for run_uvdata_uvsim also implements a send and receive protocol for run_uvdata_uvsim where the tasks are chunked and sent out to PUs on request.

Motivation and Context

I like how tqdm looks honestly and was tired of two gross branches continually rebasing. This allows for all backends depending on the user's preference. I think I would prefer having some kind of plugin or something to allow custom progress bars but that sounds much more complicated.

TODO:

• [ ] Show reference sims are identical
• [ ] benchmarking reference sims
• [ ] Documentation/tutorial about backend selection
• [ ] changelog

Types of changes

• [ ] Bug fix (non-breaking change which fixes an issue)
• [x] New feature (non-breaking change which adds functionality)
• [ ] Breaking change (fix or feature that would cause existing functionality to change)
• [ ] Reference simulation update or replacement
• [ ] Documentation change (documentation changes only)
• [ ] Version change
• [ ] Build or continuous integration change

Checklist:

For all pull requests:

• [x] I have read the contribution guide.
• [x] My code follows the code style of this project.

New feature checklist:

• [x] I have added or updated the docstrings associated with my feature using the numpy docstring format.
• [ ] I have updated the documentation to highlight my new feature (if appropriate).
• [x] I have added tests to cover my new feature.
• [x] All new and existing tests pass.
• [ ] I have checked that I reproduce the reference simulations or if there are differences they are explained below (if appropriate). If there are changes that are correct, I will update the reference simulation files after this PR is merged.
• [x] I have checked (e.g., using the benchmarking tools) that this change does not significantly increase typical runtimes. If it does, I have included a justification in the comments on this PR.
• [ ] I have updated the CHANGELOG.

[codecov[bot]]

Codecov Report

Attention: Patch coverage is 96.33028% with 8 lines in your changes missing coverage. Please review.

Project coverage is 98.44%. Comparing base (0876a90) to head (f4e5b25).

Files	Patch %	Lines
src/pyuvsim/uvsim.py	95.72%	8 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #358 +/- ## =========================================== - Coverage 100.00% 98.44% -1.56% =========================================== Files 11 11 Lines 2165 2317 +152 =========================================== + Hits 2165 2281 +116 - Misses 0 36 +36 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[aelanman]

While I fully support switching to tqdm over progsteps, I'm still not convinced of the push/pull model for task distribution. Has it been shown conclusively that active distribution performs better than the existing system? It looks like it should be capable of about the same performance except with an added overhead from using blocking sends to return visibilities to rank 0.

[mkolopanis]

Definitely part of this endeavor is to just get the technology in the repo right alongside the other things in order to test it better. There were branches before, but it was almost impossible to rebase or something after a new feature was brought in. Even just sitting on this branch, it is much easier to make a comparison.

I think one thing we should do is to get a few really good timing tests. We could always drop the send/recv part in the end.