ray-project / ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://ray.io
Apache License 2.0
34.04k stars 5.78k forks source link

[RLlib][Feature] Tensorboard image logging #21954

Open smorad opened 2 years ago

smorad commented 2 years ago

Search before asking

Description

It's not currently possible to log images to tensorboard. We could change that by making some changes here: https://github.com/ray-project/ray/blob/8119b62640aab4c3e14927feaefe2fdc9678c32a/python/ray/train/callbacks/logging.py#L285-L289

Use case

Training policies which take input images as observations, or enabling custom data/policy visualization.

Related issues

https://github.com/ray-project/ray/issues/14836

Are you willing to submit a PR?

RocketRider commented 2 years ago

Should be added to TBXLogger from tune as well: https://github.com/ray-project/ray/blob/8119b62640aab4c3e14927feaefe2fdc9678c32a/python/ray/tune/logger.py#L211