opea-project / GenAIEval

Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination
Apache License 2.0
22 stars 39 forks source link

Missing dependencies in evals/benchmark/stresscli/requirements.txt #97

Open joshuayao opened 2 months ago

joshuayao commented 2 months ago

Reproduce the issue:

cd evals/benchmark/stresscli
pip install -r requirements.txt
./stresscli.py load-test --profile run.yaml

Issue: Missing sseclient:

Traceback (most recent call last):
  File "/root/miniforge3/envs/opea-eval/bin/locust", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/main.py", line 108, in main
    docstring, _user_classes, shape_classes = load_locustfile(_locustfile)
                                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/util/load_locustfile.py", line 70, in load_locustfile
    loader.exec_module(imported)
  File "<frozen importlib._bootstrap_external>", line 940, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/root/josh/GenAIEval/evals/benchmark/stresscli/locust/aistress.py", line 12, in <module>
    import sseclient
ModuleNotFoundError: No module named 'sseclient'

Missing transformers after installing sseclient:

Traceback (most recent call last):
  File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 340, in run
    self.execute_next_task()
  File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 373, in execute_next_task
    self.execute_task(self._task_queue.popleft())
  File "/root/miniforge3/envs/opea-eval/lib/python3.11/site-packages/locust/user/task.py", line 490, in execute_task
    task(self.user)
  File "/root/josh/GenAIEval/evals/benchmark/stresscli/locust/aistress.py", line 74, in bench_main
    reqData = bench_package.getReqData()
              ^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'str' object has no attribute 'getReqData'