search

KaylaCrush / advocacy-maps

The good governance project (GGP) is a non-partisan democracy reform group.
https://mapletestimony.org
MIT License
0 stars 1 forks source link

add launch option to generate testing data #78

Closed KaylaCrush closed 1 year ago

KaylaCrush commented 1 year ago

testing data should grab five unique data pages for each kind of table of each type each year. So num_tables2num_years all together. Then save them to a (test?) database to test sql stuff on.

Maybe try and include some really weird ones if I can find some? maybe I should just pickle the test urls separately

KaylaCrush commented 1 year ago

done, sort of. I have a method that just goes thru the urls one by one till it has ten from each year. god it sucks, why did I let the urls get so disorganized?! Why can't the urls just have useful info or tags or something instead of just being character salad?