search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.61k stars 651 forks source link

Custom preview of datasets #1088

Open jax79sg opened 1 year ago

jax79sg commented 1 year ago

Instead of just automatically selecting samples to preview from dataset, allow users to either upload them separately as well.

Motivation

There are situations where we would want to prevent previews from being shown, for security reason. In other cases, we might like to select the sample that best represents the diversity of the datasets. Today we have no control to add nor remove any sample previews from the clearml datasets UI.

Related Discussion

If this continues a slack thread, please provide a link to the original slack thread.

eugen-ajechiloae-clearml commented 1 year ago

Hi @jax79sg! We indeed don't have an interface for this (we should). In the meantime, you could report custom samples using

Task.current_task().get_logger().report_media(oneof(["Images", "Videos", "Audio", "HTML", "JSON"]), file_name, local_path=file_path)

or

Task.current_task().get_logger().report_table("Tables", "summary", table_plot=table_plot)