search

ai-computing / aicomp

Other
13 stars 1 forks source link

Memory leak in gptj 6B model training #13

Closed ememos closed 4 days ago

ememos commented 6 months ago

Memory leak occurs when running the GPT-J 6B model.

ememos commented 6 months ago

The process of storing the results of the loss calculation in the data structure has been fixed.