url_matcher: Check file size via HEAD request

mrshu / brutal-plugins

A set of plugins for brutal, the mighty chatbot

Apache License 2.0

4 stars 2 forks source link

Closed mrshu closed 9 years ago

mrshu commented 9 years ago

Make sure we do not download a 100MB PDF just because it's located at some URL.
This commit fixes a bug that caused issues in deployment. The constant 5e6 reflects the author's assumption about nice, readable web documents at the time of commiting this piece of code.

Signed-off-by: mr.Shu mr@shu.io

mrshu commented 9 years ago

to @tWido, @pepol

cc @Adman @JakubNvk

(@tWido++ for actually running into this and reporting it).

pepol commented 9 years ago

LGTM

Adman commented 9 years ago

LGTM