-
Let's represent the described protocol as a simplified finite state machine (FSM). Here are the states and transitions:
1. **State 1: Initial**
- Initial state where the conversation begins.
…
-
In a scratch buffer, evaluating
```
(let ((provider (make-llm-claude
:key (exec-path-from-shell-getenv "CLAUDE_API_KEY")
:chat-model "claude-3-5-sonnet-20240620…
-
# Domain
data pipeline optimisation
# Description
The focus of this scrum spike is to help the team familiarize with prompt engineering techniques that we will use to improve the interaction with th…
-
-
Hi, I have a question about why the int4-AWQ PPL results of the LLaMA-2 model very different from the paper?
in paper result, LLaMA-2 + int4-AWQ PPL result is **5.60**, but I got PPL result is **16.3…
-
Dear Author,
Thanks for your great projects.
I was trying to evaluate the model without Tuning and with Tuning. I wondered if we can evaluate the model with the original model.
Also, if I want to…
-
See sister issue for OAK with the details https://github.com/INCATools/ontology-access-kit/issues/617
Info from email:
> The [OAEI Bio-ML track](https://www.cs.ox.ac.uk/isg/projects/ConCur/oaei/…
-
Hello, I have tried lots of different version combinations to make the LLaMA script work, it produces very bad results which is
also what I observed with my own implementation and some other implemen…
-
### Describe the bug
Working from the understanding that LLaVA hosted via an OpenAI proxy like LiteLLM, as well as GPT4-V hosted in Azure or OpenAI are both valid options for the MultimodalConversabl…
-
### What is the issue?
I love to run tests to compare different model outputs. To do so, I've used tools like promptfoo or langfuse (over Haystack or Langchain). In these tools, you set a list of mod…