Feat/strategy performance page v2

tomasgaudino commented 2 months ago

Steps to run strategy performance page:

Infrastructure:
- In https://github.com/hummingbot/deploy base dir, after running, stopping and archiving a bot there should be an archived folder, containing all of the bot run information
- Backend API image should be up to https://github.com/hummingbot/backend-api/pull/36, as referenced in docker-compose.yml file. This step will be omitted after PR is merged and built into official docker image.

Then just run on dashboard project make run. Strategy performance page should be available.

To start analyzing, you should create a checkpoint. If your databases are running or has internal errors won't show in the select box. To create a checkpoint, just select a few and click on "Save", in Create checkpoint section. This will consolidate all databases into a single one.

Global Results

This section starts showing all controllers information within the checkpoint. You can select one or more to analyze performance.

Global Aggregated Metrics

Here you can see the overall performance of your controller or controllers over time.

Execution section

Here you can select a single controller, fetch candles via BackendAPI and see the performance on top of the asset price over time.

If you switch to Controller Config tab, you can see the controller config used to trade, and you can add a host and send it to someone (i.e. @nikspz can send to @rapcmia 's a config remotely)

Export Tables

In the last section, all raw information contained in the checkpoint should be downloadable in csv format

rapcmia commented 2 weeks ago

https://github.com/hummingbot/backend-api/pull/36

rapcmia commented 2 weeks ago

Ran initial tests:

Performance page / strategy performance now available on dashboard

Getting error when accessing the strategy performance page


2024-11-07 19:08:04.494 Uncaught app exception
Traceback (most recent call last):
File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/requests/models.py", line 974, in json
return complexjson.loads(self.text, **kwargs)
File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/simplejson/__init__.py", line 514, in loads
return _default_decoder.decode(s)
File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/simplejson/decoder.py", line 386, in decode
obj, end = self.raw_decode(s)
File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/simplejson/decoder.py", line 416, in raw_decode
return self.scan_once(s, idx=_w(s, idx).end())
simplejson.errors.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/streamlit/runtime/scriptrunner/script_runner.py", line 584, in _run_script exec(code, module.dict) File "/Users/rapcomia/github/hummingbot/dashboard/184/frontend/pages/performance/bot_performance/app.py", line 46, in asyncio.run(main()) File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/asyncio/runners.py", line 44, in run return loop.run_until_complete(main) File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/asyncio/base_events.py", line 649, in run_until_complete return future.result() File "/Users/rapcomia/github/hummingbot/dashboard/184/frontend/pages/performance/bot_performance/app.py", line 23, in main checkpoint_data = display_etl_section(backend_api) File "/Users/rapcomia/github/hummingbot/dashboard/184/frontend/visualization/performance_etl.py", line 9, in display_etl_section db_paths = backend_api.list_databases() File "/Users/rapcomia/github/hummingbot/dashboard/184/backend/services/backend_api_client.py", line 323, in list_databases return self.post(endpoint) File "/Users/rapcomia/github/hummingbot/dashboard/184/backend/services/backend_api_client.py", line 38, in post return self._process_response(response) File "/Users/rapcomia/github/hummingbot/dashboard/184/backend/services/backend_api_client.py", line 55, in _process_response return response.json() File "/Users/rapcomia/miniconda3/envs/dashboard/lib/python3.10/site-packages/requests/models.py", line 978, in json raise RequestsJSONDecodeError(e.msg, e.doc, e.pos) requests.exceptions.JSONDecodeError: Expecting value: line 1 column 1 (char 0)



Steps to reproduce:
1. Setup this PR with https://github.com/hummingbot/backend-api/pull/36 and broker
2. Go to `Strategy Performance` page

notion-workspace[bot] commented 2 weeks ago

Feat/strategy performance page v2 #184

hummingbot / dashboard