Cdaweb direct file access

[jeandet]

Big PR, mostly adding direct archive support plus some refactoring around http module. Direct Archive support means, Speasy can access servers with no webservices or any local folder as long as:

• remote server enables mod_dir or generates some html files for each folder where Speasy can extract the file list
• files are split regularly or at least start date can be parsed from file names
• file are ISTP compliant CDFs

Most interesting parts for review are:

• archive module itself here and here for downloaders strategies
• former HTTP module has been split into:
  • New AnyFiles module, it abstracts access to a file either locally or remotely for speasy with opt-in caching for remote files.
  • Reworked HTTP module that focuses on http transactions with retry and timeouts.
  • New URL utils module that focuses on URL manipulation and parsing
• AMDA and CDAWeb have been refactored to use new HTTP AnyFiles an URL modules
• Test are here:
  • direct archive
  • AnyFiles
  • url utils

The module is documented here and human readable here.

This PR also adds PyYAML as new dependency.

[codecov[bot]]

Codecov Report

Patch coverage: 88.32% and project coverage change: +2.62 :tada:

Comparison is base (3187bdb) 83.86% compared to head (1df08de) 86.49%.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## main #89 +/- ## ========================================== + Coverage 83.86% 86.49% +2.62% ========================================== Files 45 51 +6 Lines 2771 3043 +272 Branches 437 473 +36 ========================================== + Hits 2324 2632 +308 + Misses 316 276 -40 - Partials 131 135 +4 ``` | Flag | Coverage Δ | | |---|---|---| | unittests | `85.86% <88.32%> (?)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#carryforward-flags-in-the-pull-request-comment) to find out more. | [Impacted Files](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop) | Coverage Δ | | |---|---|---| | [speasy/webservices/amda/inventory.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L3dlYnNlcnZpY2VzL2FtZGEvaW52ZW50b3J5LnB5) | `80.18% <0.00%> (ø)` | | | [speasy/webservices/amda/\_impl.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L3dlYnNlcnZpY2VzL2FtZGEvX2ltcGwucHk=) | `77.67% <44.44%> (+9.53%)` | :arrow_up: | | [speasy/core/cdf/\_\_init\_\_.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L2NvcmUvY2RmL19faW5pdF9fLnB5) | `75.47% <57.14%> (+2.97%)` | :arrow_up: | | [speasy/core/dataprovider.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L2NvcmUvZGF0YXByb3ZpZGVyLnB5) | `89.61% <66.66%> (+0.13%)` | :arrow_up: | | [speasy/core/inventory/indexes.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L2NvcmUvaW52ZW50b3J5L2luZGV4ZXMucHk=) | `90.90% <75.00%> (ø)` | | | [speasy/webservices/cda/\_\_init\_\_.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L3dlYnNlcnZpY2VzL2NkYS9fX2luaXRfXy5weQ==) | `81.91% <83.33%> (-0.56%)` | :arrow_down: | | [speasy/core/cdf/inventory\_extractor.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L2NvcmUvY2RmL2ludmVudG9yeV9leHRyYWN0b3IucHk=) | `85.71% <85.71%> (ø)` | | | [speasy/webservices/csa/\_\_init\_\_.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L3dlYnNlcnZpY2VzL2NzYS9fX2luaXRfXy5weQ==) | `87.39% <88.88%> (+2.59%)` | :arrow_up: | | [speasy/core/any\_files.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L2NvcmUvYW55X2ZpbGVzLnB5) | `89.47% <89.47%> (ø)` | | | [speasy/webservices/generic\_archive/\_\_init\_\_.py](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop#diff-c3BlYXN5L3dlYnNlcnZpY2VzL2dlbmVyaWNfYXJjaGl2ZS9fX2luaXRfXy5weQ==) | `89.55% <89.55%> (ø)` | | | ... and [16 more](https://app.codecov.io/gh/SciQLop/speasy/pull/89?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop) | | ... and [2 files with indirect coverage changes](https://app.codecov.io/gh/SciQLop/speasy/pull/89/indirect-changes?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=SciQLop)

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Do you have feedback about the report comment? Let us know in this issue.

[jeandet]

@brenard-irap can we merge this now?