search

ReaLLMASIC / nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.
MIT License
23 stars 17 forks source link

Fix non euler base calculation for exppolymax #160

Closed gkielian closed 4 months ago

gkielian commented 4 months ago

Two changes:

  1. torch.log is the natural log
  2. bringing the ln(a) into the (n-1)th root