carverauto / threadr

🌎 OSS Real-time AI Data Analysis with GraphDB integration. 🔍
Apache License 2.0
17 stars 1 forks source link

Offload embeddings #12

Closed mfreeman451 closed 9 months ago

mfreeman451 commented 9 months ago

Instead of creating embeddings inline in our event processor using OpenAI API and incurring charges, going to write the message and relevant information to the NATS queue and let a consumer handle vectorizing and storing it back into neo4j vector index.