chronosphereio / calyptia-benchmark-framework

Fluent Bit, Fluentd + other projects benchmark framework
0 stars 0 forks source link

benchmark results cannot be loaded by dashboard #3

Closed edsiper closed 2 years ago

edsiper commented 2 years ago

Running a simple test on Linux with the following command and then trying to load the dashboard, it fails with finding the results:

python3 benchmark.py -s tail_null -l fluent-bit,stanza
.....
--------------------------------------------------------------------------

SUCCESSFULLY FINISHED in 00:00:29

Scenario Execution Times:

Name         Elapsed Time
---------  --------------
tail_null         29.8225

--------------------------------------------------------------------------

running the dashboard:

$ python3 dashboard.py 
/home/edsiper/coding/benchmark-framework/dashboard.py:6: UserWarning: 
The dash_html_components package is deprecated. Please replace
`import dash_html_components as html` with `from dash import html`
  import dash_html_components as html
/home/edsiper/coding/benchmark-framework/dashboard.py:9: UserWarning: 
The dash_core_components package is deprecated. Please replace
`import dash_core_components as dcc` with `from dash import dcc`
  import dash_core_components as dcc
Traceback (most recent call last):
  File "/home/edsiper/coding/benchmark-framework/dashboard.py", line 25, in <module>
    scenario_results = os.listdir( os.path.join(scenario_dir, 'results') )
FileNotFoundError: [Errno 2] No such file or directory: 'scenarios/__pycache__/results'

note: copying the results from scenarios/tail_null/results/* to scenarios/__pycache__/results fixes the problem.

I think results should be send to a different path like:

conapi-stefan commented 2 years ago

@edsiper did you set the PYTHONPYCACHEPREFIX as mentioned in the readme? If this is set then these pycache folders are created outside the scenarios tree. I think then this does not happen.

edsiper commented 2 years ago

thanks for the suggestion,yeah, that fixed the issue after removing all the pycache dirs