-
### Describe the issue
Hello, I am trying to use Autogen for this multiagent healthcare system. The code looks like this:
config_list = [
{
"model": "gpt-3.5-turbo-16k",
…
-
Looking at the RAGAs sample notebook ...
[https://github.com/langchain-ai/langsmith-cookbook/blob/main/testing-examples/ragas/ragas.ipynb](https://github.com/langchain-ai/langsmith-cookbook/blob/ma…
-
**Describe the bug**
Once ragas is installed I want to import it and I got an error on the import of pydantic output parser from langchain.
Ragas version: 0.1.6
Python version: 3.10
LangChain vers…
-
-
I encountered an issue while evaluating a dataset using the ragas library with the Langchain LLM and Sentence Transformer embeddings. The process throws an exception during execution.
**Steps to Repr…
-
Harness being one of the general evaluation frameworks for hundreds of tasks and benchmarks on different types of metrics.
- check LM EValuation Harness [here](https://github.com/EleutherAI/lm-eva…
-
I noticed in the paper that 'In total, we collected 2,000 malicious documents for training with an average number of tokens of 702.79'. However, I do not find these malicious documents within the repo…
-
Hi,
I am trying to run some LLMs (currently trying openai models) on MMLU. My first question is which configuration is the standard setup (5 shot without CoT)? What does flan mean in some of the c…
-
As mentioned in the paper - "Furthermore, we also invite some expert annotators to label task planning for some complex requests (46 examples) as a high-quality human annotated dataset. We also plan t…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
** How do I specify the name of the model**
An LLM is deployed locally. …