add comment pointing out EFA configuration

foundation-model-stack / fms-fsdp

🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

https://pytorch.org/docs/stable/fsdp.html

Apache License 2.0

162 stars 27 forks source link

add comment pointing out EFA configuration #38

Closed nairbv closed 6 months ago

nairbv commented 7 months ago

just a minor comment drawing attention here, since lack of this LIB path has a big impact on perf in our environment.

lchu-ibm commented 6 months ago

@nairbv thank you.