Add rope-scaling parameters to export_model.py

LAION-AI / Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

https://open-assistant.io

Apache License 2.0

37.1k stars 3.24k forks source link

Add rope-scaling parameters to export_model.py #3618

Closed andreaskoepf closed 1 year ago

andreaskoepf commented 1 year ago

Add two new command line parameters which when present override the model's rope-scaling configuration: --rope_scaling_type: linear, dynamic (default="linear") --rope_scaling_factor: set rope scaling factor (float >1.0)