Wire DPO - Githubissues

arcee-ai / arcee-python

The Arcee client for executing domain-adpated language model routines https://pypi.org/project/arcee-py/

https://www.arcee.ai

25 stars 5 forks source link

Closed Jacobsolawetz closed 3 months ago

Jacobsolawetz commented 3 months ago

Adds DPO route through alignment - is not configurable and runs a stock general DPO set

shahrzads commented 3 months ago

LGTM - I like DPO feature for alignment being added