pytorch / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
4.04k stars 821 forks source link

pytest: test_example_torch_compile.py is faling #3189

Open agunapal opened 2 weeks ago

agunapal commented 2 weeks ago

🐛 Describe the bug

test_example_torch_compile.py is failing with the nightly binaries

Error logs

=========================== short test summary info ============================
FAILED test_example_torch_compile.py::test_torch_compile_inference - AssertionError: assert ['tiger_cat',...'plastic_bag'] == ['tabby', 'ti...'plastic_bag']
  At index 0 diff: 'tiger_cat' != 'tabby'
  Full diff:
  - ['tabby', 'tiger_cat', 'Egyptian_cat', 'lynx', 'plastic_bag']
  ?  ---------
  + ['tiger_cat', 'tabby', 'Egyptian_cat', 'lynx', 'plastic_bag']

Installation instructions

NA

Model Packaging

NA

config.properties

N/A

Versions

Nightly

Repro instructions

Nightly run https://github.com/pytorch/serve/actions/runs/9477756728/job/26147581551

Possible Solution

sort and compare the list elements

agunapal commented 2 weeks ago

It seems like the the order is different in conda compared to PyPI.

Will need to check on standalong PyTorch if the results vary between PyTorch & Conda. Checking the sorted list to unblock