Closed ghgmail closed 4 days ago
What is the difference between nGPT.py and nTransformers.py? And are they from two different papers? Thank you very much
@ghgmail nTransformer is just nGPT without the embedding and logit projection, a stack of attention and feedforwards
What is the difference between nGPT.py and nTransformers.py? And are they from two different papers? Thank you very much