There's lots of testing code here that is good, but as we're approaching the end of the quarter, I think it is time to clean it up and formalize it. You can move the code for actually running the pipeline to a script in the scripts directory. Get rid of testing code that you aren't using. Make sure there is some path to saving your outputs... right now they just disappear!
https://github.com/dsi-clinic/2024-winter-climate-cabinet-campaign-finance-tracker/blob/a86a4eb7311773d503a0e1bfa96298b48a27e097/src/utils/orgs_classification_data_pipeline.py#L886
There's lots of testing code here that is good, but as we're approaching the end of the quarter, I think it is time to clean it up and formalize it. You can move the code for actually running the pipeline to a script in the scripts directory. Get rid of testing code that you aren't using. Make sure there is some path to saving your outputs... right now they just disappear!