Open scarlett2018 opened 4 years ago
History Backlog Info Backup, only for reference.
~[Planned in #4898 ] Cell as sku in hived scheduler.~
~[Planned in #4898] Support dynamic sku types in different vc.~
@hzy46 : ~[Planned in #4898] pod/event watcher to support #4649~ ~[Planned in #4898 ] multi cluster management detailed design & review~
@suiguoxin: #4789 ~[Planned in #4898] Alert-manager: Kill low-gpu-utilization jobs, tag abnormal jobs, Cordon node with k8s API when GPU GCC Error~ ~[Planned in #4898] Job tags : DB table, rest-server API, web-portal refactor~
@yiyione: ~[Planned in #4898] Group management page in webportal~ ~[Planned in #4898] VC request management for user and admin~
@debuggy:
Per Task Retry History
Multi-Cloud/Multi-Cluster
@hzy46
AutoScaler @ydye
Support for large scale cluster
GPU Utilization
More examples for the current examples
Add user team support
Surfacing more backend error to users in Job Details Page #4649 @qfyin ,@yqwang-ms potential failure case: storage mount failed
[ ] Surfacing more backend error to users (GCC error, out of storage, etc.)
[ ] K8S Pod keep waiting in creating container, such as ErrImagePull #3572
[ ] GPU Fairness Usage @Binyang2014
[ ] Usability improvement based on user study and feedback @yangou1988
Service plug-in (user customized) @hzy46
Jupyter Notebook support @hzy46
Runtime interface @Binyang2014
HiveD Improvements (i.e. aware per GPU bad, etc.) @yqwang-ms @zhypku
FC detect the preemption, gc, eviction, etc. @yqwang-ms
FC rescale Framework @yqwang-ms
Update the official docker image (comparing with deepo) @hzy46
Installation experience
parameters
to env
#4636These are incomplete items from v0.17
[ ] Grafana metrics link does not have time interval
[ ] Skip intra communication for elastic job (Binyang https://github.com/microsoft/pai/issues/3708)
[ ] Bring back debug mode (Binyang https://github.com/microsoft/pai/issues/3643, https://github.com/microsoft/pai/issues/2210)
[ ] replace disk cleaner with k8s pod eviction policy (https://github.com/microsoft/pai/issues/3340, https://github.com/microsoft/pai/issues/3765)
[ ] When job is waiting, show the detailed waiting reason somewhere in the job page. (https://github.com/microsoft/pai/issues/3847)
[ ] Archive logs to system provided storage
[ ] Exec to job containers on webportal
[ ] persist service log (https://github.com/microsoft/pai/issues/2129)
[ ] differentiate opportunistic job and normal jobs in VC usage page.
[ ] improve user group adding to VC experience
[ ] improve HiveD configuration experience
[ ] Show job priority in webportal
[ ] introduce a new job state "initialization" (https://github.com/microsoft/pai/issues/4141)
[ ] open ssh
connection in browser
[ ] ssh
key management and simplifying user behavior of ssh
plugin
[ ] open ssh
connection in browser
[ ] favorite jobs https://github.com/microsoft/pai/issues/2749
[ ] actual resource usage of a job https://github.com/microsoft/pai/issues/4695
[ ] Favorite Jobs
Engineering Excellent
Low Priority Postponed items
This issue is a long term backlog for planning and discussion. Please feel free to add "the top in your mind" to this issue directly.
Last Updated on 02/01/2021
Top Focus Scenario
Multi-Cloud/Multi-Cluster
Job management
AutoScaler
Engineering Excellent
More examples for the current examples
Add user team support
Jupyter Notebook support
FC detect the preemption, gc, eviction, etc. @yqwang-ms
FC rescale Framework @yqwang-ms
Update the official docker image (comparing with deepo) @hzy46
Installation experience
parameters
toenv
#4636