Closed NanoCode012 closed 1 month ago
This config was not parsed yet used within the code. This fixes it.
Yes, with Gemma-2-2b to set attn_implementation.
Description
This config was not parsed yet used within the code. This fixes it.
Motivation and Context
How has this been tested?
Yes, with Gemma-2-2b to set attn_implementation.
Screenshots (if appropriate)
Types of changes
Social Handles (Optional)