Update llama repo emb interface for newer transformers

microsoft / TransformerCompression

For releasing code related to compression methods for transformers, accompanying our publications

MIT License

354 stars 31 forks source link

Closed pashminacameron closed 3 months ago

pashminacameron commented 3 months ago

Newer transformers packages need this (seqlen has been dropped). Needs testing.