[BUG] Correcting summary lens

[joofio]

1. correct title and use language for it
2. try to add html formatting to endpoint
3. apply logic similar to the others lenses of epi and ips added in the body

EDIT:

4. Performance

[joofio]

@aalonsolopez corrected the first one on my repo (upstream), can you look at the second and i will take a look at the third

[aalonsolopez]

A question: Adding HTML formatting you mean in the response? For example:

<div>{{summary}}</div>

[joofio]

no, what I meant with the HTML is formatting the output in terms of styling. how it currently looks:

see the bullets?

[aalonsolopez]

Ah! Of course, I can substitute the markdown bullets to an HTML unordered list

[joofio]

we hope to be more generic. but that would be a good first step. we could also tweak with the prompt.

i suggest first taking on the errors and then this.

[aalonsolopez]

Perfect

[aalonsolopez]

A question. When the Lens fails because the model requested is not found, what is the expected output? Returning an error? Or picking another model "by default" to always have a useful response?

[joofio]

Error A unknown model should not happen in production

[aalonsolopez]

Summary Lens is working rn

[joofio]

Added performance now.

[aalonsolopez]

Today I will start looking how can we cache requests

[aalonsolopez]

Temperature set to 0, Seed set to 1234. For my recent tests, the answers appear to be deterministic (or almost all, if the response varies may be for some changes in the prompt). @joofio give it a try.

[joofio]

it is in dev i assume right?

[joofio]

currently not working in dev.

[aalonsolopez]

at least rn it is working