search

nick7nlp / Counting-Stars

Counting-Stars (★)
https://arxiv.org/abs/2403.11802
MIT License
76 stars 2 forks source link

Clarifications on M and N #1

Open chen-yingfa opened 7 months ago

chen-yingfa commented 7 months ago

It is still not clear to me, after reading README, what M and N actually means. My current understanding is that the input context is split into N chunks of equal lengths, and each "counting star" sentence is inserted between every pair of chunks. If this is the case, what does M determine?

Thanks in advance.

nick7nlp commented 7 months ago

We add a figure in the README to explain the idea of the Counting-Stars, which also explains the parameters M and N.

nick7nlp commented 7 months ago

If you have any more questions, feel free to let me know.

chen-yingfa commented 7 months ago

Forgive me for still not understanding the image in README, what does "counting times" actually mean? In the first column, what if the "counting times" is 20, does it mean that there are 20 different locations with "xxx counting xxx stars" inserted?

nick7nlp commented 7 months ago

yes

chen-yingfa commented 7 months ago

So the "counting stars" sentences do not have to be inserted on the boundaries of chunks? If so, what is the meaning of chunking?

nick7nlp commented 7 months ago

我明白你的意思了，我又更新了下README里的图了，这下应该没有歧义了。谢谢你哈。