coleam00 / bolt.new-any-llm

Prompt, run, edit, and deploy full-stack web applications using any LLM you want!
https://bolt.new
MIT License
3.88k stars 1.59k forks source link

feat(code-template): Add Code Template System and Tool Calling Infrastructure #302

Open thecodacus opened 6 days ago

thecodacus commented 6 days ago

Add Code Template System and Tool Calling Infrastructure

Overview

This PR introduces two major architectural enhancements:

  1. A code template system for project scaffolding
  2. A foundational infrastructure for AI tool calling with an agent-based architecture

These changes enable more sophisticated project initialization and lay the groundwork for AI-driven tooling capabilities.

Key Changes

1. Template System Implementation

2. Tool Calling Infrastructure

3. Agent System

4. UI Enhancements

Technical Implementation

Agent Architecture

Template System

Tool Execution Pipeline

  1. Tool call parsing and validation
  2. Agent selection and routing
  3. Parameter validation
  4. Tool execution
  5. Response formatting and streaming

Testing

Migration Impact

Future Enhancements

Preview

https://github.com/user-attachments/assets/ba3c180c-625b-4d5d-87d1-2580ed6ff5a0

thecodacus commented 6 days ago

@wonderwhy-er , sorry but I tried to make the changes as little as possible 😅

thecodacus commented 6 days ago

Also this approach is text based, to it can be used by any llm, as long as it follows the structured output and does not get confused. that require prompt tuning which can be done in separate task

we can now add agents for github project import or commit, using this framework

wonderwhy-er commented 6 days ago

Ok, will need to take a deeper look in to how it works

thecodacus commented 5 days ago

this is an example of git import using the tooling framework

https://github.com/user-attachments/assets/6ab045c6-9614-4c41-9410-7263ff10affe

wonderwhy-er commented 5 days ago

Ahh its still big, will take time to fully review...

champ2050 commented 4 days ago

@thecodacus Awesome work! Thank you for your contribution. Have you had a chance to check out Microsoft's Magnetic-One? It includes an orchestrator that passes commands to specific agents, each designed to handle particular tasks. If you could take a look at it, that might make a fantastic addition to this project. Magnetic-One was recently released, so not many people have seen it yet, but it works really well. Thanks again for your awesome work, I really appreciate it!

thecodacus commented 3 days ago

no I didn't get the chance to see that yet. will definitely check that