Vahe1994 / SpQR

Apache License 2.0
515 stars 40 forks source link

fixed RefinedWeb vs RefinedWebModel in modelutils.py and main.py #25

Closed poedator closed 1 year ago

poedator commented 1 year ago

1) apparently falcon models have inconsistent information in field model_type of config.json. Encountered both RefinedWebModel and RefinedWeb. This PR allows both these values as well as prospective valueFalcon.

2) added trust_remote_code=True to AutoConfig loading, consistent with trust_remote_code param in model loading. (used with Falcon)