Closed leothomas closed 11 months ago
This PR adds a step the ingestion pipeline which first checks if the given records belongs to a file known to have speech or other data quality issues, and skips its ingestion
This PR adds a step the ingestion pipeline which first checks if the given records belongs to a file known to have speech or other data quality issues, and skips its ingestion