-
Hi, I fine-tuned a model (yam-peleg/Experiment26-7B) using unsloth. Then during inference, model correctness drops when using unsloath FastLanguageModel. I see some modules are replaced. It looks a li…
-
**Describe the bug**
A clear and concise description of what the bug is.
I tried using RAGAS with a model that is not OpenAI. In general whatever model I use I get this error back:
```
File …
-
Hello Andrew, thank you for your excellent contributions to the translation agent! I am reaching out to highlight our recent work, "**TEaR: Improving LLM-based Machine Translation with Systematic S…
-
https://github.com/rlancemartin/auto-evaluator
https://autoevaluator.langchain.com/
-
## Methodology Discussion
SentinelGuard is supposed to integrate Large Language Model Services (LLMs), Machine Learning & Deep Learning (ML&DL) methods, and Rule-based filters to identify intrusion…
zhsh9 updated
1 month ago
-
Thanks for this refreshing take on LLM prompt generation and evaluation, it's very promising.
I was wondering if few-shot examples should have their own first-class support in BAML due to their pow…
mbbyn updated
2 weeks ago
-
Hello,
Is there a version available that supports the BIRD dataset? I noticed that there is support for BIRD in the code, but I am not sure if the fewshot folder needs to be regenerated on the BIRD t…
-
# Proposed Feature
Add an efficient interface for generation probabilities on fixed prompt and completion pairs. For example:
```python
# ... load LLM or engine
prompt_completion_pairs = [
…
-
### What happened?
`GGML_ASSERT: D:\a\llama.cpp\llama.cpp\ggml.c:12853: ne2 == ne02`
### Name and Version
```
version: 2965 (03d8900e)
built with MSVC 19.39.33523.0 for x64
```
### What operati…
-
when i do inference with qwen2, i got the following error:
```
You are using a model of type qwen2 to instantiate a model of type llama. This is not supported for all configurations of models and …