Closed Criamos closed 1 year ago
This PR includes:
poetry
pyproject.toml
requirements.txt
serlo_spider
.env
SERLO_INSTANCE="de"
science_in_school_spider
license
lifecycle
This PR includes:
poetry
to the project (see: https://python-poetry.org), currently used for dependency managementpyproject.toml
necessaryrequirements.txt
was auto-generated by poetry (which also improves reproducibility during debugging/onboarding/project setup)serlo_spider
(v0.2.9):.env
-SettingSERLO_INSTANCE="de"
you can choose to only crawl learning objects from the German Serlo.org instancescience_in_school_spider
(v0.0.5):license
edge-cases by removing the crawler-specific license mapping and instead using the LicenseMapper utility classlifecycle
-items