The scraper scrapes datasets that do not comply to the schema and have empty values / nulls in required fileds. Ranking needed to be disabled as there are problems with the parsing
We need automatic pickling / NLP on the incoming csv, this was hardcoded and couldn`t be changed in this MR
Scope
Make scraper output available on server, restart docker to rerun csv ingestion into redis.
Changes
Issues / Out of scope