fetches a list of files in the mirror's server via rsync
convert that rsync output to a list of relative paths
import those paths to the Url table of the database
The first and thirs steps are very long.
The second step used to be done with sed with explicit support for macOS but it was
broken (at least on macOS), transforming the file into a list of \1 lines…
this replicates the sed step in-python with no risk to fail on any platform
setup_urls()does essentially three things:The first and thirs steps are very long. The second step used to be done with sed with explicit support for macOS but it was broken (at least on macOS), transforming the file into a list of
\1lines…this replicates the sed step in-python with no risk to fail on any platform