[Roadmap] Q2 2024

[peterschmidt85]

This issue outlines the major items planned for Q2 2024. Note that it doesn't include bug fixes, except for major issues.

[!NOTE] Bold means priority.

Core features

• [x] Multi-node support https://github.com/dstackai/dstack/pull/1103
• [x] Parity YAML and CLI https://github.com/dstackai/dstack/pull/943 #1011
• [x] More granular permissions #1101 #1138
• [x] Support for on-prem servers https://github.com/dstackai/dstack/pull/1115 https://github.com/dstackai/dstack/pull/1189
• [ ] Allow attaching volumes https://github.com/dstackai/dstack/issues/1158
• [x] Support private subnets #1201 #1171 #1264 #1304
• [ ] Implement dstack apply #1223 #1326 #1327
• [x] Allow instance reuse by other users https://github.com/dstackai/dstack/issues/896
• [x] Make sure retry policy works for all types of instances #1200
• [ ] Scheduling tasks via CRON

Architecture

• [ ] AMD GPU
• [ ] Intel Gaudi
• [ ] TPU https://github.com/dstackai/dstack/issues/956
• [ ] Intel GPU
• [ ] AWS Inferentia
• [ ] AWS Trainium

New providers

• [x] RunPod https://github.com/dstackai/dstack/pull/1063 https://github.com/dstackai/dstack/issues/1137 https://github.com/dstackai/dstack/issues/1118 https://github.com/dstackai/dstack/issues/1297
• [x] Oracle #1194
• [ ] Alibaba Cloud

Provider improvements

• [x] A10 support in Azure https://github.com/dstackai/dstack/issues/1014
• [ ] H100 support in AWS https://github.com/dstackai/dstack/issues/1238
• [ ] H100 support in Azure https://github.com/dstackai/dstack/issues/1239
• [ ] H100 support in GCP #1240
• [ ] L4 support in AWS https://github.com/dstackai/dstack/issues/1235
• [ ] Reserved instances in AWS https://github.com/dstackai/dstack/issues/1155
• [ ] Reserved instances in GCP
• [ ] Reserved instances in Azure
• [ ] Spot instances in TensorDock
• [ ] Spot instances in Vast.ai
• [ ] AMD support in Azure
• [ ] AMD support in GCP
• [x] Spot instances in RunPod
• [x] Bare metal support in Oracle #1194
• [x] Multi-node support in Oracle #1194
• [ ] Spot instances in Oracle

Examples

[!IMPORTANT] Community help is needed!

• [x] H4 Alignment Handbook https://github.com/dstackai/dstack/pull/1180
• [x] Axolotl https://github.com/dstackai/dstack/pull/1187
• [ ] TensorRT-LLM
• [ ] Triton
• [ ] Function calling
• [x] LoRAX
• [ ] Cog

Documentation

• [ ] Improvements based on the feedback
• [ ] Troubleshooting
• [x] Best practices

[!IMPORTANT] If you notice something important missing here, please write about it in the comments.

[peterschmidt85]

Replaced by https://github.com/dstackai/dstack/issues/1350