search

emencia / django-local-ai

Run a local AI from Django with Llama.cpp
MIT License
12 stars 1 forks source link

Impressive, but I don't get the Vue-Django link #3

Open j2l opened 5 months ago

j2l commented 5 months ago

Hi there, Very nice project, I love the idea! After download and using your (great!) make routines, I had my first Emencia generated email. As a former marketing director myself, it's impressive (and maybe too long) :smile:

I can see the Django LM tasks table, but I see the Demo page is hard coded, not linked to Django DB LM tasks. I wonder why it's not linked. What is the use of Django, besides the generate view?

Bonne journée à toute votre équipe !

synw commented 5 months ago

Hi, thanks for your interest. You are right that the demo page is just hardcoded for now. This project has essentially been a demo, and started like that. The lm tasks table you can see is an early prototype for the idea of getting a database of well crafted prompts. This could then be used by the frontend with an api.

It would need more work to design the database and api more carefully: a task is the association between a model, a prompt, a prompt template and some inference parameters. To be efficient the storage has to be template agnostic, and support few shots prompting. The tasks would also need some classification system as well

Once there will be a proper tasks api we could then use it with frontend inference apps, like my gui here: https://github.com/synw/infergui . Vue is used here but it does not matter, it could be any js based app

What do you think about the idea of starting a proper language models tasks database using Django?

j2l commented 5 months ago

Thank you @synw

What do you think about the idea of starting a proper language models tasks database using Django?

I'd love to see this happen, but I think I'm not enough into code to be able to help :disappointed: .