[feat] support async in bedrockLLM by loop.run_in_executor

geekan / MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

https://deepwisdom.ai/

MIT License

43.96k stars 5.23k forks source link

Closed Wei-Jianan closed 2 months ago

Wei-Jianan commented 3 months ago

Features

Support async in BedrockLLM by using run_in_executor in asyncio to bypass the intrinsic sync implementation of boto3

Influence