andgineer / lexiflux

AI-powered foreign text reader for language learners (Django)
1 stars 0 forks source link

LLama 3 and Zephir 7B produce broken json #42

Closed andgineer closed 3 months ago

andgineer commented 3 months ago

Examples of results that expected to be json

1) "Here are 7 examples of sentences with the term "hiljadu" in Serbian: [" .. valid array 2) Series of "Response: { " in one text 3) "Response: json { "..."" - also that could be after just plain text, or many times 4) "Here is the output in JSON format: {", "Here is the JSON output: { " .. and after JSON some irrelevant text about what the model did

also do not remove markers || and **