search

cagov / data-orchestration

Orchestration tooling for the CalData Data Services and Engineering team
MIT License
0 stars 0 forks source link

Update data urls #8

Closed ian-r-rose closed 1 year ago

ian-r-rose commented 1 year ago

Also crawl the remaining sites where CalInnovate uses the feedback form. Fixes #7

cc @aaronhans

ian-r-rose commented 1 year ago

Thanks for the review!

* The digital.ca.gov site is now at innovation.ca.gov so data from the last few months use the innovation.ca.gov domain

Do you think the source field in the result table should become innovation in this case? Or should we keep it as digital to maintain continuity with older data?

aaronhans commented 1 year ago

I don't know how the views of the data work but seems like using innovation as source would be good if we could update all the older records to match.

It has been awhile since we made the domain change though so there may be little interest in historical data from the old domain

ian-r-rose commented 1 year ago

I don't know how the views of the data work but seems like using innovation as source would be good if we could update all the older records to match.

Yeah, I'm not too worried about it. We could update the old records later if it becomes a problem. For now, I'm just making the new records have a source of innovation.