It is likely necessary for long term maintainability to have unit tests which either cache or pull a webpage from the various media sites and tests the extractions.
We can store an html page, locally or as an artifact and test. Possibly a timed job to periodically re-fetch the pages and verify the tests.
It is likely necessary for long term maintainability to have unit tests which either cache or pull a webpage from the various media sites and tests the extractions.
We can store an html page, locally or as an artifact and test. Possibly a timed job to periodically re-fetch the pages and verify the tests.