-
# Description
We would like to add the integration between TestSpark and the HuggingFace platform to allow the use of more (smaller) models for test generation. Using models should be possible both u…
-
**建築評価データセット作成プロジェクト**
* Googleで建築データが入っているサイト等を検索
* サイトから選択肢質問と回答をスクレイピング
* [このような形](https://github.com/nlp-waseda/JMMLU/blob/main/JMMLU/conceptual_physics.csv#L1)
* データセットをEval Harnessにコミッ…
-
As we continue refining our application, establishing a reliable method to measure the quality of the app’s suggestions becomes crucial. This issue proposes the development of a 'yardstick' or benchma…
-
During the evaluation process, I noticed that the models have different lengths, such as qwen-128, and the length is measured using the tokenizer of gpt-3.5-turbo. For qwen 128k, should it be set as 1…
-
## Issue encountered
While setting up the framework to evaluate using LLM-as-judge, it would be helpful to test end-to-end without special permissions like setting up openai_key or HF pro subscriptio…
-
## Goal:
Create compact TensorFlow Lite (TFLite) models that can be deployed on mobile devices for offline use, specifically for agricultural pest detection and document handling tasks. These models …
-
Given existing support for GPT-J and its rotary embeddings, is LLaMA supported as well? Huggingface just shipped their implementation: https://github.com/huggingface/transformers/commit/464d4207756538…
-
-
**Describe the bug**
When integrating LlamaIndex with Arize Phoenix it fails with an error message `ModuleNotFoundError: No module named 'opentelemetry.semconv.attributes'`
**To Reproduce**
Steps…
-
### Is there an existing issue for the same bug?
- [X] I have checked the troubleshooting document at https://opendevin.github.io/OpenDevin/modules/usage/troubleshooting
- [X] I have checked the exis…