-
https://dl.acm.org/citation.cfm?id=1610180
-
Hi! I've started working on my own QG algorithm for my Masters thesis and I'm trying to learn how to evaluate a model.
Since you've posted your metrics, I've been trying to replicate them, but I a…
-
In line 37 below, shouldn't it be "_this is one reference sentence for sentence2_". Instead, it says this is a reference sentence for **_sentence2_** which was _**generated by your model**_. If I unde…
-
- [ ] [[2308.07201] ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate](https://arxiv.org/abs/2308.07201)
# [ChatEval: Towards Better LLM-based Evaluators through Multi-Agent De…
-
Right now we have to use the line - realise_en = Realiser(host = "nlg.kutlak.info" , port = 40000)
to create the realiser and make the code run . What does this line do?
moreover, if I wanted to r…
-
Hi, I am wondering if there is a way to parameterize the system's response. For example, we use
_system: greeting_
to let the NLG say something like "hi there" (the mapping from speech act _greetin…
-
**Describe the feature**
Provide unified, fast evaluation script for Benchmark using unified datasets #11 and standard dataloaders #14
Evaluation metrics:
- [x] NLU: Acc, dialog act tuple P/R/F1
…
-
**Describe the feature**
Transform the following datasets into the [Unified format](https://github.com/ConvLab/ConvLab-3/blob/master/data/unified_datasets/README.md) under `data/unified_datasets`. Su…
-
https://aclanthology.org/2021.emnlp-main.599/
-
i just followed the steps of the installation and everything is going well, it says it's listening but the probleme is i want GTTS to analyse my language as french i changed everything to french in th…