search

delphi-suite / delphi

small language models training made easy
Apache License 2.0
9 stars 1 forks source link

what is not a `PreTrainedModel`? #127

Closed jettjaniak closed 4 months ago

jettjaniak commented 5 months ago

Why do we need this?

    model = train_results.model
    if isinstance(model, PreTrainedModel):
        model.save_pretrained(
            save_directory=results_path,
        )
    else:
        st.save_model(
            model,
            os.path.join(results_path, "model.safetensors"),
        )
jettjaniak commented 4 months ago

@jaidhyani

jaidhyani commented 4 months ago

Probably a relic of the llama2c era