Closed MinaAlmasi closed 1 year ago
Modify how to allow for batching of datasets for generating completions. Showed performance increases in duration on CPU. GPU still needs testing.
Follow up on #21
Modify how to allow for batching of datasets for generating completions. Showed performance increases in duration on CPU. GPU still needs testing.