Add a --hw filter for Pytest to optionally run only tests using some particular device
Motivation
We need a test for the VCK5000 to expand the test coverage to more boards.
Implementation
Implementation is similar to that of the tests on U250 FPGA boards: pre-process the data and construct a request -> load the resnet50 model -> send the request to the server -> get the response and post-process.
The addition here is to allow Pytest to set a custom environment per test which can be configured by the test. For now, the default environment for U250 is unchanged. It should be updated to match the latest released device (currently V70).
Notes
This PR requires existing users to redownload the test assets (resnet50 models for U250 and VCK5000 boards) or this test will give an error about missing assets.
Summary of Changes
--hw
filter for Pytest to optionally run only tests using some particular deviceMotivation
We need a test for the VCK5000 to expand the test coverage to more boards.
Implementation
Implementation is similar to that of the tests on U250 FPGA boards: pre-process the data and construct a request -> load the resnet50 model -> send the request to the server -> get the response and post-process.
The addition here is to allow Pytest to set a custom environment per test which can be configured by the test. For now, the default environment for U250 is unchanged. It should be updated to match the latest released device (currently V70).
Notes
This PR requires existing users to redownload the test assets (resnet50 models for U250 and VCK5000 boards) or this test will give an error about missing assets.
It is an updated version of #206