j-andrews7 / kenpompy

A simple yet comprehensive web scraper for kenpom.com.
https://kenpompy.readthedocs.io/en/latest/?badge=latest
GNU General Public License v3.0
70 stars 21 forks source link

Fix for Cloudflare SSL profiling #38

Closed esqew closed 1 year ago

esqew commented 1 year ago

Hi @j-andrews7 - this PR is to merge the identified fix relating to the TLS fingerprinting it seems was likely the culprit behind the sporadic reports of Cloudflare filtering requests made by the library to KenPom.com (#33).

The fix included in this PR re-enables the DES cipher, which seems to make our requests look much nicer to Cloudflare in environments running Python <3.11.x.

A big thanks to @nickostendorf whose research provided yesterday was ultimately able to identify this as the likely core issue.