Only download content pdf or doc(x) files that are below a filesize threshold

openeduhub / metalookup

Provide metadata about domains w.r.t accessibility, licencing, adds, etc.

GNU General Public License v3.0

5 stars 0 forks source link

Only download content pdf or doc(x) files that are below a filesize threshold #110

Open MRuecklCC opened 2 years ago

MRuecklCC commented 2 years ago

Just performance/stability considerations. Imagine there are a couple of 100mb file to process through. Even better would be to only download the file completely if it is below that size, but I don't know how.

_Originally posted by @MRuecklCC in https://github.com/openeduhub/metalookup/pull/109#discussion_r897683266_