smol-ai / developer

the first library to let you embed a developer agent in your own app!
https://twitter.com/SmolModels
MIT License
11.79k stars 1.03k forks source link

Class to facilitate embedding generated documents to ChromaDb #70

Open k-nearest-neighbor opened 1 year ago

k-nearest-neighbor commented 1 year ago

Simple traversal of the generated directory and adding to a local ChromaDB store.

from src.embeddings import Embeddings
e = Embeddings(debug=True)
e.persist_generated_file_contents()

Output:

embedding: generated/popup.js
embedding: generated/styles.css
embedding: generated/background.js
embedding: generated/popup.html
embedding: generated/shared_dependencies.md
embedding: generated/content_script.js
embedding: generated/manifest.json

persisted embeddings for 7 files.

This diff makes a few design choices though, like the introduction of a source directory.