search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
11.7k stars 1.48k forks source link

Ability to add custom `compute_kind` icons #14967

Open razafinl opened 1 year ago

razafinl commented 1 year ago

What's the use case?

Dagit is used extensively to monitor jobs but also provide a visual representation of our asset and data pipelines catalog.

compute_kind is used to quickly categorize and understand which underlying system or datasource is being used for a given asset/data pipeline.

As mentioned in this discussion, a set of compute_kind for popular technologies are shown with associated icons and can easily be recognized when navigating asset list.

For more specific use-cases, we would like to be able to extend the list of icons associated to compute_kind tags.

Ideas of implementation

A specific folder containing list of custom icons with a map between icon and compute_kind tag could be provided to Dagit instance(s) so that icon can be displayed on the Web UI instead of generic name and color.

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a 👍! We factor engagement into prioritization.

smackesey commented 1 year ago

cc @bengotow @hellendag

Does this seem feasible to you?

bengotow commented 1 year ago

Hey folks, thanks for filing this! We discussed this on our roadmap call today and I think it would be cool, but we'd like to approach it as part of a larger effort to add this kind of customization to Dagster Cloud (we don't have a framework for uploading the images or including them as part of the deployment), and possibly a re-imagining of these compute tags.

One short-term hack might be to use emoji as your custom compute kinds, which I noticed someone was doing in #17570.