bellingcat / auto-archiver

Automatically archive links to videos, images, and social media content from Google Sheets (and more).
https://pypi.org/project/auto-archiver/
MIT License
489 stars 53 forks source link

improve config parsing to accommodate type casting and validation rules #130

Open msramalho opened 4 months ago

msramalho commented 4 months ago

As it stands the logic to handle the configs() method of each Step (like Archivers, Enrichers, ...) does not cast int/float/bool and uses only strings. Likewise it's proven quite useful to specify validation rules in the configs rather than relying on the init method of each Step to do so.

This issue is on adding both of those configuration parsing mechanisms and refactoring existing Steps that are doing internal casting/validation.

msramalho commented 2 months ago

this still remains a good coding challenge that would make developing new features smoother.