lencx / ChatGPT

🔮 ChatGPT Desktop Application (Mac, Windows and Linux)
https://nofwl.com
52.06k stars 5.85k forks source link

[Bug] COMPUTATIONAL GLITCH #1121

Closed Dnyanal121 closed 9 months ago

Dnyanal121 commented 9 months ago

Non-ChatGPT bug

Version

v1.1.0

Bug description

A bug where it fails to calculate the correct solution of 15 numbers and give different solutions every time when regenerated. This issue was due to the implementation of softmax activation function which will lead to a probabilistic model output, generating inaccuracies. Thus, the fix to this bug was replacing the softmax activation function in the GPT architecture with more accurate activation function

OS

Windows 11

Environment

No response