google / fhir-data-pipes

A collection of tools for extracting FHIR resources and analytics services on top of that data.
https://google.github.io/fhir-data-pipes/
Apache License 2.0
140 stars 80 forks source link

Support for fetching FHIR resources via Bulk export mode #1082

Open chandrashekar-s opened 1 month ago

chandrashekar-s commented 1 month ago

Description of what I changed

Fixes #1031

E2E test

TESTED:

Checklist: I completed these to help reviewers :)

codecov-commenter commented 1 month ago

Codecov Report

Attention: Patch coverage is 37.25490% with 192 lines in your changes missing coverage. Please review.

Project coverage is 51.63%. Comparing base (1db3398) to head (30b4fe9).

Files Patch % Lines
...c/main/java/com/google/fhir/analytics/FhirEtl.java 0.00% 58 Missing :warning:
...java/com/google/fhir/analytics/BulkExportUtil.java 45.36% 43 Missing and 10 partials :warning:
...main/java/com/google/fhir/analytics/FetchUtil.java 5.40% 35 Missing :warning:
...ava/com/google/fhir/analytics/PipelineManager.java 37.50% 15 Missing :warning:
...java/com/google/fhir/analytics/FhirSearchUtil.java 72.09% 5 Missing and 7 partials :warning:
...java/com/google/fhir/analytics/DataProperties.java 20.00% 6 Missing and 2 partials :warning:
...e/fhir/analytics/converter/JsonDateSerializer.java 0.00% 4 Missing :warning:
...e/fhir/analytics/model/BulkExportHttpResponse.java 57.14% 3 Missing :warning:
...oogle/fhir/analytics/model/BulkExportResponse.java 81.81% 0 Missing and 2 partials :warning:
...fhir/analytics/converter/JsonDateDeserializer.java 60.00% 1 Missing and 1 partial :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #1082 +/- ## ============================================ - Coverage 51.92% 51.63% -0.30% - Complexity 697 725 +28 ============================================ Files 91 98 +7 Lines 5519 5746 +227 Branches 709 732 +23 ============================================ + Hits 2866 2967 +101 - Misses 2390 2497 +107 - Partials 263 282 +19 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

chandrashekar-s commented 4 weeks ago

Hi @bashir2, this PR contains changes to support FULL_RUN only. I will raise a separate PR for supporting INCREMENTAL_RUN (have created this issue for the same).