Intrivo - Sender onboarding

[sliu1000]

Karim Lalani (Klalani@intribo.com) has completed the TOS. @jbiskie is there anything else the Karim needs to do?

[sliu1000]

@jbiskie Karim Lalani from Intrivo is looking for an update on the recent sample messages sent. They would like to understand what the next steps/timeline is to start operating in full production mode.

[sarahnw]

@jorg3lopez Intrivo is basically good to go once we get 5700 released. they did send over more test messages asking us to look at them. could you help with that this sprint?

[sliu1000]

@jorg3lopez

Hi Jorge, Intrivo identified some issues with their recent testing. Please see below the list of errors they receive in response to their submission:

"message" : "For fl-phd.elr, filter hasValidDataFor[patient_dob] filtered out item a419be90-b378-46c7-b734-b1c64e2e3a71" "message" : "For hhsprotect.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item a419be90-b378-46c7-b734-b1c64e2e3a71" "message" : "For hhsprotect.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr, filter hasValidDataFor[message_id, equipment_model_name, specimen_type, test_result, patient_last_name, patient_first_name, patient_dob] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr-otc, filter atLeastOneHasValue[Y, test_authorized_for_otc, test_authorized_for_home, test_authorized_for_unproctored] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr-otc, filter matches[sender_id, ImageMover] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr-otc-test, filter atLeastOneHasValue[Y, test_authorized_for_otc, test_authorized_for_home, test_authorized_for_unproctored] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "message" : "For vt-doh.elr-secondary, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234" "submissionId" : 17533344, "overallStatus" : "Not Delivering"

[shy2cdc]

We are currently blocked by these below errors.

Could you please assist us in identifying the issues with our recent test messages?

This is the list of errors we are receiving in response to our submission:

"message" : "For fl-phd.elr, filter hasValidDataFor[patient_dob] filtered out item a419be90-b378-46c7-b734-b1c64e2e3a71"

  "message" : "For hhsprotect.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item a419be90-b378-46c7-b734-b1c64e2e3a71"

  "message" : "For hhsprotect.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr, filter hasValidDataFor[message_id, equipment_model_name, specimen_type, test_result, patient_last_name, patient_first_name, patient_dob] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr-otc, filter atLeastOneHasValue[Y, test_authorized_for_otc, test_authorized_for_home, test_authorized_for_unproctored] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr-otc, filter matches[sender_id, ImageMover] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr-otc-test, filter atLeastOneHasValue[Y, test_authorized_for_otc, test_authorized_for_home, test_authorized_for_unproctored] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

  "message" : "For vt-doh.elr-secondary, filter doesNotMatch[processing_mode_code, T, D] filtered out item f3950988-1ebf-44d2-8789-2a6c6d5ef234"

"submissionId" : 17533344, "overallStatus" : "Not Delivering"

[sliu1000]

Updated Status/Communications:

From: Karim Lalani klalani@intrivo.com Sent: Tuesday, August 2, 2022 5:27 PM Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Thanks, Sarah.

Jorge, I've shared a sample HL7 message and the resulting error report with you over Keybase. Please let me know when you've had a chance to review it.

Regards,

Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

---

From: White, Sarah (CDC/DDPHSS/OD/HITSSU) tlk9@cdc.gov Sent: Tuesday, August 2, 2022 1:09 PM Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Hi Karim, please see Jorge's email below

Sarah White (Nava PBC) Senior Product Manager Pandemic-Ready Interoperability Modernization Effort (PRIME) Centers for Disease Control and Prevention

---

From: Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov Sent: Monday, August 1, 2022 5:14 PM Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Hi Karim,

Thank you for your patience. I am looking into this matter; it seems you might have a few missing or invalid format entries in some fields. It would be of tremendous help if you could send us the test data that you are sending to the API. You can send it to me via an encrypted email or at my KeyBase account. Once I receive it, I'll review it and give you feedback on it. Thank you, I look forward to your reply.

KeyBase: jorg3lopez (Send a message introducing yourself to verify connection)

Jorge

[jorg3lopez]

Update:

I received the test file from Karim. The next step is to replicate the error and give feedback.

[sliu1000]

@jorg3lopez Follow-up questions from Karim (Intrivo).

Is there any documentation/list of states like FL, where this would pose an issue?

Communication/Background Info: From: Karim Lalani klalani@intrivo.com Sent: Thursday, August 4, 2022 12:38 PM To: Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov; Report Stream (CDC) reportstream@cdc.gov; White, Sarah (CDC/DDPHSS/OD/HITSSU) tlk9@cdc.gov Cc: Juluru, Krishna (NIH/NIBIB) [E] krishna.juluru@nih.gov; Weitz, Andrew (NIH/NIBIB) [E] andrew.weitz@nih.gov; Farid Poonja fpoonja@intrivo.com; Reeves, Maurice (CDC/OD/OCS) qva8@cdc.gov; Biskie, Joel (CDC/DDPHSS/OD/HITSSU) (CTR) rtz3@cdc.gov Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Thanks, Jorge.

This certainly helps clarify things a little more. Is there any documentation I might consult with to get a list of states, like FL, where this would pose an issue?

Regards,

Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

From: Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov Sent: Thursday, August 4, 2022 11:36 AM To: Karim Lalani klalani@intrivo.com; Report Stream (CDC) reportstream@cdc.gov; White, Sarah (CDC/DDPHSS/OD/HITSSU) tlk9@cdc.gov Cc: Juluru, Krishna (NIH/NIBIB) [E] krishna.juluru@nih.gov; Weitz, Andrew (NIH/NIBIB) [E] andrew.weitz@nih.gov; Farid Poonja fpoonja@intrivo.com; Reeves, Maurice (CDC/OD/OCS) qva8@cdc.gov; Biskie, Joel (CDC/DDPHSS/OD/HITSSU) (CTR) rtz3@cdc.gov Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Hi Karim,

RS takes the data without the need of the DOB. This works for OTC data as it usually comes with more missing fields. Though this is perfectly ok, there might be issues at the receiver's end. Some receivers, like Florida, have filters that block reports without DOB because they only want reports that have a DOB. So, by not including the DOB, your test file will not be accepted by these receivers, but your data will be received by the ones that accept no DOB.

I hope this answers your question. If you have any other questions let me know, I will be happy to assist you.

Jorge From: Karim Lalani klalani@intrivo.com Sent: Wednesday, August 3, 2022 3:58 PM To: Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov; Report Stream (CDC) reportstream@cdc.gov; White, Sarah (CDC/DDPHSS/OD/HITSSU) tlk9@cdc.gov Cc: Juluru, Krishna (NIH/NIBIB) [E] krishna.juluru@nih.gov; Weitz, Andrew (NIH/NIBIB) [E] andrew.weitz@nih.gov; Farid Poonja fpoonja@intrivo.com; Reeves, Maurice (CDC/OD/OCS) qva8@cdc.gov; Biskie, Joel (CDC/DDPHSS/OD/HITSSU) (CTR) rtz3@cdc.gov Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Thanks, Jorge. I think we are sending age instead of Data of Birth as the documentation mentioned we could provide either. Do we need to send the full DoB for anonymized reporting as well?

Regards,

Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

From: Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov Sent: Wednesday, August 3, 2022 5:32 PM To: Report Stream (CDC) reportstream@cdc.gov; Karim Lalani klalani@intrivo.com; White, Sarah (CDC/DDPHSS/OD/HITSSU) tlk9@cdc.gov Cc: Juluru, Krishna (NIH/NIBIB) [E] krishna.juluru@nih.gov; Weitz, Andrew (NIH/NIBIB) [E] andrew.weitz@nih.gov; Farid Poonja fpoonja@intrivo.com; Reeves, Maurice (CDC/OD/OCS) qva8@cdc.gov; Biskie, Joel (CDC/DDPHSS/OD/HITSSU) (CTR) rtz3@cdc.gov Subject: Re: [External] Intrivo Diagnostics ready to onboard fully - ReportStream - 5/9/2022

Hi Karim,

After reviewing the file and running it through our api, we noticed that PID-7 was blank. After adding a date / time of birth, everything looked good. Please add an input for PID-7, make sure is in this format: 19820601000000-0000

The processing code error is due to the code being ​T​. This should stay as is as we are still in testing phase. Populate PID-7 and send the test data again. ​​

Let me know if you have any other issue, thank you.

Jorge

[sliu1000]

@jorg3lopez @BerniXiongA6

Karim Lalani from Intrivo is requesting you to review a pair of HL7 payloads.

Would like to know the next steps in order to transition from test mode to live mode.

Full Communication below: Hello Jorge, We modified our HL7 generation code to always include patient DOB and that resolved all the errors with anonymized report submissions. We are however still seeing some errors when we use the same code but include patient information. I've sent you a pair of HL7 payload and the resulting error response over keybase. Could you please review them and advise on how we might resolve those?

We would also like to know what the next steps would be in order to transition from test mode to live mode.

Regards, Karim Lalani | Engineering Lead

[jorg3lopez]

Update:

Intrivo sent new test data to review. I will review and provide an update soon.

[BerniXiongA6]

@kjt9cc -- Jorge is reviewing the new test data from Intrivo... he's committed to updating us on this soon. We're getting close!

[shy2cdc]

Karim 8/17 5:23pm

We've sent 20 messages to Vermont (submissionId 18541085) and another 20 to Hawaii (submissionId 18541134).

[BerniXiongA6]

Hey @sarahnw Per @jorg3lopez -- we should let Hawaii and Vermont know that they will be receiving data from Intrivo, and to let us know if there are any issues due to the files. Jorge will be sending this data manually once he has reviewed the files. I'm happy to reach out if we know who the contact persons are? cc: @shy2cdc

[shy2cdc]

@BerniXiongA6 I forgot to respond to you I'm sorry. I reached out to Vermont and Hawaii last week.

[sliu1000]

@jorg3lopez @BerniXiongA6 - We received an email Karim Lalani from Intrivo asking for a status update, please see below for more information:

8/26/22 at 10:49 AM

Hi Jorge, We are still waiting for details around errors for the samples submitted for VT a few days ago.

Can you provide an ETA on those?

Regards, Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

On Wed, Aug 24, 2022 at 5:14 PM Karim Lalani klalani@intrivo.com wrote: Thanks for the update, Jorge. We'll wait for further details from VT.

Best regards, Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

On Wed, Aug 24, 2022 at 4:49 PM Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov wrote: Hi Karim,

Thank you for your patience. Vermont got back to us and pointed out that there were a few discrepancies that caused test files to fail in their system. They will provide feedback with detailed information soon; I will notify you once they give me their feedback. Thank you, have a great rest of your day.

Jorge

[jorg3lopez]

Update:

Still waiting for VT to get back to us. Intrivo has voiced that this delay is affecting their timelies on their projects.

[BerniXiongA6]

I sent this email to VT today with a cc: to @sarahnw and @jorg3lopez

Hello Vermont team!

My colleague, Sarah White, introduced me a couple of weeks ago as the new delivery manager for our Onboarding and Operations team. While Sarah is currently out on vacation, I'm following up to see if your team has any feedback regarding Intrivo's previous submission. Intrivo has expressed concern that the delay in getting their data validated is beginning to affect their timelines for other projects, so they are asking us for next steps. If you have any insights into this matter or how we can help, we're happy to assist.

Thank you!

Best, Berni

[BerniXiongA6]

While we await a response from VT DOH, I also replied to Karim to let her know current status. cc: @sarahnw @jorg3lopez

Hi Karim,

Thank you so much for reaching out. My colleague, Sarah White, is currently on vacation so I'll be handling this issue in her absence. The quick update is, Jorge and I are still waiting on Vermont Dept. of Health to respond with feedback after your previous submission. I put in a note to them today. I let them know of the urgency of this request, so hopefully we hear from them soon. Please feel free to reply if you have any other questions. I'm happy to help and Jorge is standing by to assist technically as well as we hear more from Vermont.

Thanks again!

Best, Berni

[BerniXiongA6]

Updates from Karim:

Jorge, Berni,

We submitted a new batch of 20 messages for the state of Massachusetts. Could you please review and let us know if there are any issues or validation errors?

Best regards, Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

On Wed, Aug 31, 2022 at 2:17 PM Karim Lalani klalani@intrivo.com wrote: Thank you, Berni, for sharing the update.

Since we are pressed for time to get the integration completed, we would like to send another batch of sample messages for another state. Hopefully, we'll get a swifter response turnaround this time as a result.

Best regards, Karim Lalani | Engineering Lead

[sliu1000]

@BerniXiongA6 @jorg3lopez

We received a follow-up on them not receiving any additional messages beyond 8/19. Please resend corrected version.

Please see below the original communication:

Hi,

We haven’t received any additional messages beyond the 8/19 ones that failed. If you can resend the corrected versions of those or new ones we can validate them.

Thanks, Jessie Vermont Team

[sliu1000]

Follow-up email sent from Karim at Intrivo -

Berni, and Jorge.

I hope you had a nice weekend.

I wanted to check the status of the recent requests we sent for MA and the errors that I shared in my previous email.

Also, I wanted to see if we might also test a sample against Colorado.

Please advise.

Karim

[sliu1000]

Update from Kaleigh from MA State:

Hi Berni,

We found this file in our production portal. In the future, can you send test files to us via email attachment? These cases did not error so they went into our reporting database as if they were actual cases.

Also, just a reminder we would only want provider administered home tests.

[shy2cdc]

Message from Karim (Intrivo) 9/8 at 7:40pm

Hello, Berni and Jorge,

Any updates on this?

I wanted to check the status of the recent requests we sent for MA and the errors that I shared in my previous email.

Also, I wanted to see if we might also test a sample against Colorado.

[sliu1000]

Update from Karim from Intrivo:

That's great news, Jorge. We'll make the change to the processing_code to P in our production environment and wait to hear from you on Monday.

Best regards, Karim Lalani | Engineering Lead 📧 klalani@intrivo.com | www.intrivo.com

On Fri, Sep 9, 2022 at 11:44 AM Lopez, Jorge (CDC/DDPHSS/OD/HITSSU) (CTR) rut7@cdc.gov wrote: Hi Karim,

Thank for being patient, we got feedback from MA and all messages checked out without any errors. Our next step is to fully, move to production. The only change that you have to do on your end is to change the processing code from T to P. Also, it is normal to have warnings and errors show up on the receivers' end during this transition. This is because some systems might need minor adjustments when digesting the data. This is totally fine; we will keep you updated if this happens.

One last thing, we will move you to production starting Monday, next week. I will reach out and confirm when this happens. Thank you, have a wonderful weekend.

Jorge

[shy2cdc]

Email from Karim 9/30 at 8:04pm

Hello all, I wanted to share an update regarding our integration with ReportStream. We processed a batch today in which we processed test results for the entire month of September for all users who had provided consent. Close to 750 test results passed our selection criteria and those reports were sent over to ReportStream.

When you get a chance, please review the submissions and let us know if you notice any errors.