CDCgov / IDWA

Intelligent Data Workflow Automation
Apache License 2.0
1 stars 1 forks source link

Spike: Understand Data formats/Integration into Maven and Clinisys #130

Open arinkulshi-skylight opened 1 week ago

arinkulshi-skylight commented 1 week ago

As part of our pilot program with STLT's we need to understand the challenges that come with putting data into Maven or Clinisys assume our data is in JSON format the question we should answer is

  1. What should the output data format look like(single entries vs bulk upload)
  2. Which data transfer protocol is utilized(SFTP,API,Queue)

Notes: Thoughts from another engineer (Dan on Dibbs) I believe you can use MIF files. MIF = Maven Interface Format. extract data with OCR transform into MIF load into Maven by delivering the MIF files I think this would work and is really just a classic ETL (Extract Transform Load) process.