[Hardware] 地端 PC for LLM training 建議配置

[A-baoYang]

• 經驗談 : https://www.pugetsystems.com/solutions/scientific-computing-workstations/machine-learning-ai/hardware-recommendations/

• 作者的建議配置 : https://www.pugetsystems.com/labs/hpc/can-you-run-a-state-of-the-art-llm-on-prem-for-a-reasonable-cost/

[A-baoYang]

• LambdaLabs multi-GPU 工作站： https://lambdalabs.com/gpu-workstations/vector
• PyTorch DDP 是透過 NVLink 運行： https://www.reddit.com/r/nvidia/comments/11aswyv/2x3090_rtx_or_1x4090_rtx_for_training_a_nn_model/

[A-baoYang]

GPU 硬體相關知識

• https://timdettmers.com/2023/01/30/which-gpu-for-deep-learning/