search

art-institute-of-chicago / data-aggregator

An API of public data collected from several different systems at the Art Institute of Chicago
GNU Affero General Public License v3.0
65 stars 6 forks source link

Feature: separate web imports [API-391] #76

Closed nikhiltri closed 1 year ago

nikhiltri commented 1 year ago

We have a considerable import:web-full console command that imports all web content into the API. It's structured to delete all local website content and import each type of data type-by-type. The downside to this logical structure is that we'll be left with many empty tables if an early import breaks.

This PR breaks up web imports into separate calls for each type so that if one breaks, its impact is limited.

sonarcloud[bot] commented 1 year ago

SonarCloud Quality Gate failed.    Quality Gate failed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 1 Code Smell

No Coverage information No Coverage information
74.3% 74.3% Duplication

idea Catch issues before they fail your Quality Gate with our IDE extension sonarlint SonarLint