search

wandb / wandb

The AI developer platform. Use Weights & Biases to train and fine-tune models, and manage models from experimentation to production.
https://wandb.ai
MIT License
9.02k stars 670 forks source link

[Feature]: Ability to log isolated events #3409

Open epignatelli opened 2 years ago

epignatelli commented 2 years ago

Description

It would be really handy to have the ability to log instantaneous events, especially in reinforcement learning projects. For example, wandb.log({"Events"; "Experience Replay starts"}, step=5000), or wandb.log({"Events"; "First reward"}, step=389).

Suggested Solution

I am imagining a table of events:

Event step
First reward 389
Experience Replay starts 5000

Alternatives

No response

Additional Context

No response

vanpelt commented 2 years ago

You can log a step independently, I.E.

wandb.log({"event": "thing", "mystep": 321})

Then you can choose a custom x-axis or filter metrics. For categorical metrics like this we don't have any native visualizations but you could use custom charts to visualize, or just pull the data via the api.

epignatelli commented 2 years ago

Tha sounds good. If there is any way I can plot a vertical line at a specific x coordinate, I think this is already solved.