AxisCommunications / acap-computer-vision-sdk-examples

Axis Camera Application Platform (ACAP) version 4 example applications that provide developers with the tools and knowledge to build their own solutions based on the ACAP Computer Vision SDK
Apache License 2.0
50 stars 23 forks source link

Spike in inference time from the inference server #190

Open akash-syook opened 3 weeks ago

akash-syook commented 3 weeks ago

Please do not disclose security vulnerabilities as issues. See our security policy for responsible disclosures.

I have trained yolov5m model and sucessfully deployed on Axis "AXIS M4317-PLR Panoramic Camera".

The avg inference time is 70-80 ms but sometimes there is a spike in inference time from inference server. I am using below repo for my custom trained yolov5 model https://github.com/AxisCommunications/axis-model-zoo/blob/main/docs/yolov5-on-artpec8.md For deployment I have used https://github.com/AxisCommunications/acap-computer-vision-sdk-examples/tree/main/object-detector-python

Added sample screenshots. Please let me know what could be wrong. Screenshot from 2024-08-21 17-06-50 Screenshot from 2024-08-21 17-08-12

Explain the behavior you would expect and the actual behavior.

To reproduce

Please provide as much context as possible and describe the reproduction steps that someone else can follow to recreate the issue on their own.

A team member will try to reproduce the issue with your provided steps. If there are no reproduction steps or no obvious way to reproduce the issue, the team will ask you for those steps. Bugs without steps will not be addressed until they can be reproduced.

Steps to reproduce the behavior:

  1. Set up '...'
  2. Do this '...'
  3. See error

Screenshots

If applicable, add screenshots to help explain your problem.

Environment

Additional context

Add any other context about the problem here.

Corallo commented 3 weeks ago

HI @akash-syook I will transfer this issue to the example repository