search

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution
Apache License 2.0
182 stars 59 forks source link

[CI] Integration tests through pytest #2109

Closed zachgk closed 1 day ago

zachgk commented 1 week ago

This combines the older integration test suite into the new pytest one. It uses the original integration action rather than the llm_integration one.

Sample run: https://github.com/deepjavalibrary/djl-serving/actions/runs/9671865360

tosterberg commented 1 day ago

With regards to Qing's comment - I do agree that this will be harder to pass, but not significantly so when compared to the large model integration script that we are folding in here. Moving to a single script and then parting out to create specific "golden" passing workflows makes sense to me.

Aside - this will remove the Large Model Inference from actions, so we will need to do a follow up CLI trigger on a release branch so that the action is still manually executable for release branches. I will do this post merge.