microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.91k stars 175 forks source link

Dummy data loading? #505

Open guqiqi opened 4 months ago

guqiqi commented 4 months ago

Is there a way to load dummy data (random value weights) for faster development and profiling? (like vllm provided with --load-format arguments)