awslabs / agent-evaluation

A generative AI-powered framework for testing virtual agents.
https://awslabs.github.io/agent-evaluation/
Apache License 2.0
118 stars 20 forks source link

In concurrent.futures.ThreadPoolExecutor set max_workers correctly. #65

Closed johntelforduk closed 6 months ago

johntelforduk commented 6 months ago

Issue #, if available: none

Description of changes: Fixes bug in class Plan. Method _run_concurrent was incorrectly setting max_workers to _num_tests. This is fixed to correctly set it to _num_threads. Consequence of the bug was that the program was ignoring the --num-threads CLI option.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.