search

EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
https://www.eleuther.ai/
Apache License 2.0
6.96k stars 1.02k forks source link

Expand Docstring #1273

Closed AI-WAIFU closed 2 months ago

AI-WAIFU commented 2 months ago

Makes behavior observed in https://github.com/EleutherAI/gpt-neox/issues/1250 explicit.