The decisions from www.rechtsprechung-im-internet.de only go back until 2010, while www.bundesverfassungsgericht.de also publishes older decisions.
This PR scrapes the digitally available decisions from the official collection (BVerfGE [0-9]+, [0-9]+).
About the half of the logic is for determining which decisions are already present on www.rechtsprechung-im-internet.de in order to avoid duplicate retrievals. This works well for now, although it might make sense to think about more generic infrastructure for coping with courts for which there are multiple relevant sources.
As a remark, www.bundesverfassungsgericht.de publishes many more decisions that are not part of the official collection, but the starting page where the decisions can be selected by year ([1]) is disallowed by their robots.txt, so I did not write a scraper for now. Not sure if there is a good way to also retrieve them, but this would open up many more decisions.
…llection
The decisions from
www.rechtsprechung-im-internet.deonly go back until 2010, whilewww.bundesverfassungsgericht.dealso publishes older decisions.This PR scrapes the digitally available decisions from the official collection (
BVerfGE [0-9]+, [0-9]+).About the half of the logic is for determining which decisions are already present on
www.rechtsprechung-im-internet.dein order to avoid duplicate retrievals. This works well for now, although it might make sense to think about more generic infrastructure for coping with courts for which there are multiple relevant sources.As a remark,
www.bundesverfassungsgericht.depublishes many more decisions that are not part of the official collection, but the starting page where the decisions can be selected by year ([1]) is disallowed by theirrobots.txt, so I did not write a scraper for now. Not sure if there is a good way to also retrieve them, but this would open up many more decisions.[1] https://www.bundesverfassungsgericht.de/SiteGlobals/Forms/Suche/Entscheidungensuche_Formular.html?language_=de