search

deepforge-dev / deepforge

A modern development environment for deep learning
https://deepforge.org
Apache License 2.0
753 stars 78 forks source link

Add support for opening artifacts with interactive explorers #1813

Open brollb opened 4 years ago

brollb commented 4 years ago

Artifacts should be able to be opened with interactive explorers/artifact explorers (the label for these is named after the latter though they should be synonymous). At a high level, the idea is that artifacts should be able to explored using some interactive UI. This UI should request an interactive compute instance and then can load arbitrary other artifacts into it, etc. When the data is saved, it is saved within the given artifact. One example of the motivation for loading arbitrary artifacts into it is evaluating a neural network; the generated metadata should be associated with the network but the test data needs to be loaded to generate the accuracy/loss metrics.

This needs to be fleshed out a little more especially around the interplay between viewing existing metadata and opening an interactive explorer. It shouldn't be too hard to resolve but still needs to be resolved before this is addressed!

brollb commented 4 years ago

Unfortunately, this means that the TensorPlotter is not currently available without patching the source code for the ArtifactIndexWidget.

umesh-timalsina commented 4 years ago

As discussed before, this would mean that when there's a whole host of Interactive explorers, they should be able to access a project's artifact. Alternatively, couldn't artifacts could directly loaded (from the explorers) ?

brollb commented 4 years ago

I have been trying to make a distinction between explorers and editors where an explorer generates some metadata node saved within an artifact and an editor saves an artifact in the artifacts index (discussed in more detail here).

Each should have their own way to access them; explorers would make sense to access by opening the artifact to explore and then having something like a prompt for which explorer to use. Editors, on the other hand, would make sense to have as a new concept in the sidebar on the left.