Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination
Apache License 2.0
22
stars
39
forks
source link
Missing dependencies in evals/benchmark/stresscli/requirements.txt #97
cd evals/benchmark/stresscli
pip install -r requirements.txt
./stresscli.py load-test --profile run.yaml
Issue:
Missing sseclient:
Traceback (most recent call last):
File "/root/miniforge3/envs/opea-eval/bin/locust", line 8, in <module>
sys.exit(main())
^^^^^^
File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/main.py", line 108, in main
docstring, _user_classes, shape_classes = load_locustfile(_locustfile)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/util/load_locustfile.py", line 70, in load_locustfile
loader.exec_module(imported)
File "<frozen importlib._bootstrap_external>", line 940, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/root/josh/GenAIEval/evals/benchmark/stresscli/locust/aistress.py", line 12, in <module>
import sseclient
ModuleNotFoundError: No module named 'sseclient'
Missing transformers after installing sseclient:
Traceback (most recent call last):
File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 340, in run
self.execute_next_task()
File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 373, in execute_next_task
self.execute_task(self._task_queue.popleft())
File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 490, in execute_task
task(self.user)
File "/root/josh/GenAIEval/evals/benchmark/stresscli/locust/aistress.py", line 74, in bench_main
reqData = bench_package.getReqData()
^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'str' object has no attribute 'getReqData'
Reproduce the issue:
Issue: Missing
sseclient
:Missing
transformers
after installing sseclient: