Failed to delete run in aim web ui

aimhubio / aim

Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.

https://aimstack.io

Apache License 2.0

4.93k stars 297 forks source link

Failed to delete run in aim web ui #3153

Open zhiyxu opened 4 weeks ago

zhiyxu commented 4 weeks ago

🐛 Bug

when deleting run in aim web ui, I got the following error, and the run is not deleted:

Error
Error while deleting runs.
Error
Failed to execute 'json' on 'Response': body stream already read

To reproduce

deleting run in aim web ui.

Expected behavior

run deleted.

Environment

Aim Version: 3.19.3
Python version: 3.10.14
pip version: 23.0.1
OS (e.g., Linux): Linux
Any other relevant information

Additional context

image(2)

SGevorg commented 2 weeks ago

Hi @zhiyxu thanks for opening this issue. @mihran113 have you had a chance to take a look at this?

mihran113 commented 2 weeks ago

Hey @zhiyxu! Is there a possibility that you can share the repo in which the run is failed to be deleted? Or any minimal example how this happened, so I can reproduce it on my end?

zhiyxu commented 4 days ago

Hey @zhiyxu! Is there a possibility that you can share the repo in which the run is failed to be deleted? Or any minimal example how this happened, so I can reproduce it on my end?

@mihran113 I found when the aim client is killed, the lock located in /.aim/locks is not released, so the run can't be deleted in the frontend. Please check #3175