-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the ex…
bullw updated
4 months ago
-
The Evaluation Status Code is missing from the Monitoring Plan Evaluation Report. In contrast, the ECMPS Evaluation Report email sent to the user does include the Evaluation Status Code.
This issue …
-
When I use the command `sh configs/inference/run.sh`, this error occurs:
```
Traceback (most recent call last): …
-
Support only the simplest queries with `strings.Contains` for now:
* [ ] `$search` field (excluding phrases and negation)
* [ ] `$language` field with the value `none` or absent
* [ ] `$caseSensitive`…
-
- [ ] [GPTScore: A Novel Evaluation Framework for Text Generation Models](https://github.com/jinlanfu/GPTScore?tab=readme-ov-file)
# GPTScore: A Novel Evaluation Framework for Text Generation Models
…
-
Thanks for your excellent work!
Any plans for releasing codes of Total-Text evaluation?
-
Hello,
Is there a version available that supports the BIRD dataset? I noticed that there is support for BIRD in the code, but I am not sure if the fewshot folder needs to be regenerated on the BIRD t…
-
The current distribution of F# for zed doesn't support running FsAutocomplete on .NET 9 preview SDKs, or any SDK that isn't explicitly supported by FSAC. When users try zed with projects that use the …
-
Hello,
We are sending following request to */reply* end point and it throws 500 exception and does not send a message.
JSON
```
{"chatId":"972547293074@c.us","session":"60107","type":"text",…
-
So I've noticed that if you embed logic in the text of a conditional choice, that logic will be evaluated even if the conditional is false:
- {false} [{myVar += 1}]
This means that the choice text is…