-
In Section 3.2 we have:
```python
>>> from __future__ import division
>>> def lexical_diversity(text):
... return len(text) / len(set(text))
```
With the line 'Here's an equivalent defini…
-
Beyond LLM supports, 4 evaluation metrics: Context relevancy, Answer relevancy, Groundedness, and Ground truth.
We would be looking forward to add new evaluation metric support to evaluate LLM/RAG…
-
It would be nice if the repo included a requirements.txt file that lists the packages needed, since some of them such as `lexical-diversity` are non-standard.
-
:red_circle: **Title** : Automated Essay Scoring System
:red_circle: **Aim** : Create a system to automatically score essays using NLP techniques.
:red_circle: **Brief Explanation** :
- Colle…
-
I add MTLD to the measure argument but the function returns nothing. There are some issues concerning how to calculate this lexical diversity measure, but the functions return a number that is bigger …
-
Thank you for this great tool!
I am testing a corpus of various sizes to get a sense of its lexical diversity, but I am hit an error message saying that some of the documents I use contain too many w…
-
These would include:
* (vocd-)D
* HD-D
See McCarthy, Philip M, and Scott Jarvis. 2010. “MTLD, Vocd-D, and HD-D: a Validation Study of Sophisticated Approaches to Lexical Diversity Assessment.” _B…
-
https://web.stanford.edu/~jurafsky/slp3/14.pdf
https://aclanthology.org/W18-4926.pdf
https://aclanthology.org/W18-4931.pdf
https://www.cmpe.boun.edu.tr/~gungort/papers/ERMI%20at%20PARSEME%20S…
-
Some of the Lexical diversity/lexical richness studies have been cited in the [Readme](https://github.com/LSYS/LexicalRichness/blob/master/README.rst).
However, the `readme.rst` does not include l…
-
- [ ] 1. Average number of non standard word
- [ ] 2. Average number of words per sentence
- [ ] 3. Percentage of short sentences (less than 8 words)
- [ ] 4. Percentage of long sentences (grea…