-
## Evaluating (open) LLMs for more languages using translated prompts
As part of MPEP, we are now at the point where some translation efforts have successfully translated 500 highly ranked prompts …
-
There have been many discussions in the community regarding support for multiple models.
- ChatGPTNextWeb#3484
- ChatGPTNextWeb#3923
- ChatGPTNextWeb#960
- ChatGPTNextWeb#3431
- ChatGPTNextWeb#…
-
It would be interesting to see measure the performance on SWE-Bench benchmarks, so that this project can be more clearly differentiated from the increasing number of other coding agents.
* https:/…
-
It would be interesting to see the performance on SWE-Bench benchmarks, so that this project can be more clearly differentiated from the increasing number of other coding agents.
* https://www.swe…
-
### System Info
In transformers/generation/util.py line:2297
The device of unfinished_sequences is same as input_ids.device()
But in line:2351, If the model is split across different GPUs, for exam…
-
Hi authors, thanks for your amazing work which contributes to long video understanding a lot!
I'm repeating your experiments on LLaVA-NeXT-Video. I meet some problems and would like to know how you …
-
# Deploy a Speech-to-Text model
These works are focused on Whisper.
## What's whisper?
Whisper is a Transformer-based model developed by OpenAI, specializing in Speech-to-Text (STT) tasks, also kno…
-
### Problem Description
能否加个选项为每个对话选择是使用自定义接口的url和key还是选择默认环境变量设置的url和key,这样中转接口可以换两个不同的地址,很方便
### Solution Description
/
### Alternatives Considered
。
### Additional Context
。
-
It would be interesting to see if/how `blar` performs against the SWE-Bench benchmarks:
- https://www.swebench.com/
- https://github.com/princeton-nlp/SWE-bench
- > [ICLR 2024] SWE-Bench: Can L…
-
### Contact Details
vicente.herrera@control-plane.io
### What is the idea
Several times there are questions on the scope of the current work done for the Simple Governance Framework. To make it pub…