search

kserve / models-web-app

KServe models web UI
Apache License 2.0
30 stars 39 forks source link

Models web app Roadmap #5

Open kimwnasptd opened 3 years ago

kimwnasptd commented 3 years ago

Lets use this issue to discuss the roadmap of the newly added web app and document the next steps. Also really looking forward to hear users' feedback and what features people would like to see, so if you have something in mind feel free to chime in!

These are some of the things I was planning to work on:

  1. Integration/e2e/unit tests kserve/models-web-app#3 kserve/models-web-app#4, which will allow us to ensure that new features won't break existing functionalities
  2. Move the Angular UI framework to version 11, from 8 which is the current version for most of Kubeflow's apps https://github.com/kubeflow/kubeflow/issues/5525
  3. Performance improvements by replacing the current poling mechanism with a more efficient implementation
    • Use persistent connections via browser-APIs/protocols, like WebSockets, Server-Side-Events etc instead of polling
    • Have the UI perform a persistent watch operation on the API server to efficiently detect changes
  4. Further integrate the app's METRICS tab with KFServing's monitoring solution
  5. Support for Multi Model Architecture
    • Exposing information about the TrainedMoleds of an InferenceService when listing the InferenceServices in a namespace
    • Allow users to create/delete/manage the TrainedModels that belong to an InferenceService
  6. Enhance the UX of creating a new InferenceService via the UI
    • Don't simply expect user to submit a YAML, but also provide an intuitive workflow for configuring the different parts of an InferenceService
    • Support for also launching TrainedModel CRs

cc @yuzisun @pvaneck @animeshsingh @StefanoFioravanzo @elikatsis @tasos-ale

goswamig commented 3 years ago

Do we plan to integrate KFServing UI with Kubeflow web UI?

kimwnasptd commented 3 years ago

@goswamig I missed this, thanks for pointing it out! Correct, we should add an entry in Kubeflow's CentralDashboard for this web app as well.

I'll also create a tracking issue for this.

davidspek commented 3 years ago

I've come up with a solution that will allow for namespace isolated Grafana dashboards without running multiple instances of Grafana (which also wouldn't work from an isolation standpoint). I think it will be important to explore this with multiple working groups, as I'm sure many of them would like to have integrated metrics dashboards. @kimwnasptd Can you explain how you are implementing Grafana authentication with the current integration in the Models Web App? Or have you enabled anonymous viewing in Grafana for the integration to work?

nongmo677 commented 3 years ago

Can't deploy Model UI to local kubeflow now?

kimwnasptd commented 3 years ago

Hi @nongqiqin, could you create a distinct issue for this so that we can further investigate there?

nongmo677 commented 2 years ago

Hi @nongqiqin, could you create a distinct issue for this so that we can further investigate there?

Found a solution, 3Q

markwinter commented 2 years ago

Move the Angular UI framework to version 11, from 8 which is the current version for most of Kubeflow's apps

I took a look at this. I think it is currently blocked by the Ace Editor module which doesn't support a new angular version