allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.69k stars 655 forks source link

Add mesh and pointcloud visualization support #1006

Open julianschoep opened 1 year ago

julianschoep commented 1 year ago

Proposal Summary

Tensorboard has support for meshes, which are critical for those working with 3D data and point-clouds. Scalars and images are currently already picked up by the clearml interface, however meshes are not. My proposal is to add support for mesh visualization.

Motivation

As stated above, models working on point-clouds or meshes are often hard to debug without visualizing meshes. Being able to visualize meshes in the clearml interface would enable such use, which sees growing interest in the ML domain.

AlexandruBurlacu commented 1 year ago

Hey @julianschoep, would Logger.report_scatter3d method work for your use-cases, before proper point-cloud support is available?

julianschoep commented 1 year ago

Yes that could work thanks for pointing it out! I mainly need mesh visualization though. For now I'll upload meshes as artifacts and view them in external software.