llm-edge / hal-9100

Edge full-stack LLM platform. Written in Rust
MIT License
369 stars 30 forks source link

annotations #18

Open louis030195 opened 9 months ago

louis030195 commented 9 months ago
louis030195 commented 9 months ago

For retrieval gotta ask in the prompt to reference sources as footnotes or something and then parse llm output into annotations and save in the message I guess

Regarding code interpreter just gotta detect when the python code generates files and save to s3 and update db and should have file endpoint make these available

louis030195 commented 9 months ago

test