The hrefs for the PDFs are inconsistent -- sometimes they're full URLs, sometimes they're only paths. Sometimes they have trailing or leading whitespace. Sometimes they're completely invalid and we get a 404
In order to be able to try to load these PDFs, I changes the error handling in utils.py. Happy to iterate if this isn't the preferred method of error handling in this codebase
2. Upgraded isort from 5.10.1 to 5.12.0
This is to resolve running into this issue. I guess I was running into this since I have poetry installed globally on my machine? Not entire sure tbh
I'm guessing other contributors may run into this problem, and there's probably no downside to this upgrade?
Once this PR is merged, I'll go ahead and put together a PR to consume these columns in warn-transformer.
2 things in this PR:
1. (Primary change): Parse individual WARN record PDFs for NY to extract:
Issue here
Some caveats here:
2. Upgraded isort from 5.10.1 to 5.12.0
This is to resolve running into this issue. I guess I was running into this since I have poetry installed globally on my machine? Not entire sure tbh I'm guessing other contributors may run into this problem, and there's probably no downside to this upgrade?
Once this PR is merged, I'll go ahead and put together a PR to consume these columns in warn-transformer.