search

smoothbrain-ai / smoothbrain-anki

SmoothBrain is an Anki plugin that fetches Readwise highlights and makes flashcards using OpenAI GPT.
39 stars 6 forks source link

Query GPT in parallel #35

Closed abdnh closed 1 year ago

abdnh commented 1 year ago

Closes #15

This uses ThreadPoolExecutor to run a maximum of 4 GPT queries in parallel. It seems to improve speed. I don't think I got errors more frequently after some brief testing.

I used the queue module in d06402ab4a4608aaed241494d785a5528c68ee6d as a (learning) experiment before landing on the cleaner ThreadPoolExecutor solution.