Update image_classifier/densenet-161 to include torch.compile - Githubissues

pytorch / serve

Serve, optimize and scale PyTorch models in production

https://pytorch.org/serve/

Apache License 2.0

4.04k stars 821 forks source link

Update image_classifier/densenet-161 to include torch.compile #3200

Closed lzcemma closed 1 week ago

lzcemma commented 1 week ago

Description

Update image_classifier/densenet-161 to include torch.compile

Add model config file Update README

Type of change

[ ] New feature (non-breaking change which adds functionality)

Testing

TorchServe starts logs

2024-06-21T15:16:28,320 [INFO ] W-9035-densenet161_1.0-stdout MODEL_LOG - [PID]3640610
2024-06-21T15:16:28,320 [INFO ] W-9002-densenet161_1.0-stdout MODEL_LOG - Python runtime: 3.12.2
2024-06-21T15:16:28,320 [INFO ] W-9035-densenet161_1.0-stdout MODEL_LOG - Torch worker started.
2024-06-21T15:16:28,320 [INFO ] W-9011-densenet161_1.0-stdout MODEL_LOG - Torch worker started.

Output prediction Logs for Test B

{
"tabby": 0.4664836823940277,
"tiger_cat": 0.4645617604255676,
"Egyptian_cat": 0.06619937717914581,
"lynx": 0.0012969186063855886,
"plastic_bag": 0.00022856894065625966
}

Checklist:

[ ] Did you have fun?
[ ] Have you added tests that prove your fix is effective or that this feature works?
[ ] Has code been commented, particularly in hard-to-understand areas?
[ ] Have you made corresponding changes to the documentation?

lzcemma commented 1 week ago

Hi @lzcemma Thanks for the PR! Can you please move the torch.compile section to the top. We want users to try torch.compile by default

Hi @agunapal Thanks for review. I updated the README and torch.compile section is on top now.