Azure / gpt-rag-ingestion

MIT License
61 stars 53 forks source link

chore: Refactor requests to work with async/await for performance and scalability #82

Closed mateoperezrivera closed 2 months ago

mateoperezrivera commented 2 months ago

This pull request includes significant changes to the chunker and embedder modules to make the codebase asynchronous. The most important changes involve converting synchronous functions to asynchronous ones and updating the imports to use asynchronous versions of libraries. These changes will improve the performance and scalability of the document chunking and embedding processes.

Conversion to Asynchronous Code:

Minor Changes: