Test plan for July vendor testing

[dan-padgett]

Overview

Create a test plan for vendor testing in July. The purpose of this testing is to determine whether registers generated by a vendor's software can be processed by the filing platform.

Test Tasks

Since the goal is to determine whether files generated by a vendor's software are processed correctly, we will need vendors to upload file that:

1. Have no errors or warnings
2. Have warnings but not errors
3. Have errors but no warnings
4. Have both errors and warnings

To help us prepare and optimize the upload process, we need to know the approximate size of the uploaded files. Therefore, we'll ask vendors:

What is the estimated average size of the file your financial institutions will upload?

Facilitation Plan

The goal is to see whether the file a vendor creates produces the correct result in our system. To learn this, we will:

• Have the vendor describe what they expect to happen with a given file
• Have the vendor upload the file
• Look at the results and discuss.

We'll repeat this for as many files as they brought to the test.

If a file upload doesn't go as expected, we will do some diagnostic work to understand the problem. But for today's call we won't troubleshoot the issue. Instead we will set up a follow up call to address the issue.

Additional Questions

• Suppose a financial institution uses your software to generate a file and uploads it to our system. If the file contains errors or warnings, what do you expect the workflow will be to correct any problems?
• If you received a validation report from a financial institution, what information is most helpful for correcting any issues? What information is least helpful? What other information would you need?
• General exploration around their needs and priorities. Based on what you have seen today, what information are tools are missing that would help you better help your customers? (Might be about the platform, might be something outside of the platform.)
• Data validator: https://github.com/cfpb/regtech-data-validator

[dan-padgett]

Closing since test plan has been made and we have started testing.