search

aiverify-foundation / moonshot

Moonshot - A simple and modular tool to evaluate and red-team any LLM application.
https://aiverify-foundation.github.io/moonshot/
Apache License 2.0
180 stars 34 forks source link

[Potential Bug] Report does not show up on Web UI sometimes #275

Open JCoder03 opened 3 months ago

JCoder03 commented 3 months ago

On some occasions (not everytime), upon a successful run, after clicking "View Report" on the Web UI, the report does not appear on the screen.

Not sure if this is the relevant error log:

[2024-07-29 16:07:31,925] [INFO] [moonshot.integrations.web_api.app]: Request origin: None

2024-07-29 16:07:31,931 [ERROR][result.py::read(42)] Failed to read result: Expecting value: line 33 column 31 (char 823)

Suspect that this occurs only when this benchmark test conducted is exactly the same as a previous test (same cookbooks and same model endpoints used).

imda-benedictlee commented 3 months ago

Hi @JCoder03, thanks for reaching out. Can I check whether this is via the UI or Web-API?

JCoder03 commented 3 months ago

It's on the Web UI.

imda-benedictlee commented 3 months ago

okay will take a look