search

taoky / tsumugu

🧵 A HTTP(S) mirroring tool written in Rust, proposed for ustcmirror
https://crates.io/crates/tsumugu
MIT License
17 stars 2 forks source link

Add fallback parser #12

Open taoky opened 3 months ago

taoky commented 2 months ago

We could consider just call lftp mirror directly to handle pages like https://sources.buildroot.net/br-cargo-home/registry/src/index.crates.io-6f17d22bba15001f/libmimalloc-sys-0.1.33/c_src/mimalloc/docs/:

image

Which might be required but absolutely not a file listing (existing tools do better for this).

taoky commented 2 months ago

f31130782732b2f9d481034a0c198d993e975ed7 (requires index.html or index.htm existing)