Restructure backend for pagination

Huy-Ngo / skin-crawler

A web crawler for crawling dermoscopic images of skin cancer.

MIT License

4 stars 2 forks source link

Restructure backend for pagination #37

Closed Huy-Ngo closed 3 years ago

Huy-Ngo commented 3 years ago

In this PR, I restructure backend for pagination-oriented to fit more with the frontend design, so each request is source/<page> instead of source/<n_images> like before.

I also:

Filter out pdf files
Add more page search for wiki
Replace _ with for titles of images crawled from wiki

Huy-Ngo commented 3 years ago

Now it can crawl 380 images from wikimedia without the PDF.