Megatron updates - Githubissues

GoogleCloudPlatform / llm-pipeline-examples

Apache License 2.0

105 stars 25 forks source link

Megatron updates #84

Closed abdallag closed 7 months ago

abdallag commented 7 months ago

Updates to allow Megatron to work on A3s

Update Megatron repo hash
Update cluster provisioning tool image
Use /run/tcpx instead of /tmp to allow megatron to use /tmp
Use latest LKG for TCPX
Fix deepspeed version