search

xenova / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!
https://huggingface.co/docs/transformers.js
Apache License 2.0
9.71k stars 571 forks source link

NanoLlava is repeating itself a lot #782

Closed flatsiedatsie closed 4 weeks ago

flatsiedatsie commented 4 weeks ago

System Info

Mac OS Brave

Environment/Platform

Description

I find that NanoLlava starts off well, but soon starts repeating itself something fierce. E.g.

The website page is also an Amazon website page, which is being displayed on a website page. The website page is also an Amazon website page, which is being displayed on a website page. The website page is also an Amazon website page, which is being displayed on a website page. The website page is also an Amazon website page, which is being displayed on a website page. The website page is also an Amazon website page, which is being displayed on a website page.

Reproduction

I implemented the minimal code example.

Is there perhaps a repetition penalty option that can be set?

(Moondream2 does not have this issue)

flatsiedatsie commented 4 weeks ago

I tihnk it may be that I was using the wrong tokenizer.