search

HTTPArchive / data-pipeline

The new HTTP Archive data pipeline built entirely on GCP
Apache License 2.0
5 stars 0 forks source link

Tech report pipeline #238

Closed giancarloaf closed 6 months ago

giancarloaf commented 8 months ago

Changes

  1. add new pipeline - tech_report_pipeline.py
  2. add new pipeline - tech_report_deletion.py
  3. update requirements to include firestore
  4. add tests for tech_report_pipeline.py
  5. update constants to include technology pipeline queries

Validation

  1. local validation for all pipelines
  2. partial validation for pipelines using Dataflow
github-actions[bot] commented 6 months ago

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)		Lines missing
  modules
  constants.py 116
  tech_report_pipeline.py 30-35, 39-52, 59-63, 67-69, 73-75, 80-81, 130-136, 141-170, 174-178
Project Total  

This report was generated by python-coverage-comment-action