chunker : The previous one skipped some turns, and was prone to crash / context overflow. Also regexp were broken and skipped locutors (especialy with a number in the name)
reworked task queue system..
Well i recoded the whole thing to make it maintenable and less buggy.
API is slightly changed. @Houpert must make some adjustments. Read documentation and Swagger
Next steps :
Make Mixtral vLLM API available remotely, wether using Exaion system or using ours (traefik endpoint)
thoroughly test template and parameters to find the sweet spot @tjiho @Siliam maybe you can help and play a bit with this
see @TODOS in code @gaydmi
Maybe after some tests we can override our client already generated summaries. The ones they have are mostly broken @Houpert if you feel like doing so this week
@houpert : must contact Nicolas en ensure proper communication with the client on the issues we had and on our process of continuous improvement within the 2 months of the testing. I put you in touch with Michel this week.
Main fixes includes :
API is slightly changed. @Houpert must make some adjustments. Read documentation and Swagger
Next steps :