allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.6k stars 649 forks source link

Preview text files #1293

Open Effervex opened 3 months ago

Effervex commented 3 months ago

Proposal Summary

When viewing a dataset, you can see the details of which files are within a dataset, but I often cannot see the content of said files. I understand there are security issues, so auto-previewing may be too far, but (double) clicking on a file could preview or download said file (if it's less than say, 5MB).

Motivation

This is simply because it would be a quick way to inspect the files of a dataset containing small simple files. Within the browser, seeing the content of files in a dataset is much quicker than writing code to download and open the file.

Related Discussion

N/A

ainoam commented 3 months ago

Thanks for suggesting @Effervex.

Note, however, that the dataset files are not stored independently but rather archived together - So the UI can't provide direct access to a specific file. clearml-data facilitates retrieving your datasets without writing code.