mikeizbicki / cmc-csci181-languages

3 stars 5 forks source link

CLI Chatbot Final Project - Ainslee & Rowan #43

Open ains-arch opened 2 weeks ago

ains-arch commented 2 weeks ago

Proposal

Our project is to design a chatbot that can interact with the user's command line and help with system administration.

  1. In which we pipe an LLM into /bin/bash and see what happens
  2. @ains-arch and @RowanGray472 at repo
  3. Outline
    1. LLaMa model or Groq
    2. RAG system with manpages (either something we download from somewhere or something that can query the ones that are already on the computer)
    3. Something that can be queried from the command line for text interface
    4. Can input to the command line and receive the outputs of the commands run in order to take further action
  4. Sources/inspiration initial X thread log demo news coverage

Rubric

Backend (50%)
15% Functional RAG system
5% Good/fast SQL database of manpages
10% Summary/keyword/prompt engineering
5% RAG system results
5% Command line utility that can recieve outputs
5% Rights management with read-only normal mode
5% Rights management with 'freestyle mode' for read-write mode
Frontend (25%)
15% It actually works (in a development environment/VM on our machine)
5% It actually works (in a production environment/bare metal on our machine)
5% It actually works (well)
Vibes (10%)
5% Engineering: Code/design quality
5% Communications: README professionalism & sysadmin Reddit posts
Research Project (15%)
5% ~20 concrete tasks with associated output/action to evaluate success
10% accuracy on read-only tasks
5% accuracy on read/write tasks
Extra Credit Opportunities (60%)
5% It's on time and under budget
5% It all runs locally
5% It takes voice input via Whisper
10% It takes voice input via Whisper that is good (uses grammar)
15% We fine tune our model
10% Our social media posts actually get attention
5% 'Freestyle mode' is funny
5% We convince you to run any of it on your machine
mikeizbicki commented 2 weeks ago

We clarified in person what "Well-implemented database", "Integration with bash" and "Experimental component" mean, but you should clarify them here in writing so I don't forget.

Also, remove the presentation 5% and put it in the experimental component portion.

ains-arch commented 2 weeks ago

Updates made.

mikeizbicki commented 2 weeks ago

Looks good :)