recover from `transformers 4.34 refactored`

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

MIT License

1.8k stars 137 forks source link

recover from `transformers 4.34 refactored` #155

Open victorlee0505 opened 1 year ago

victorlee0505 commented 1 year ago

this PR is for #154.

I believe PreTrainedTokenizer super().__init__(**kwargs) attempted to use get_vocab from LLM but self._llm = llm is not yet set, hence it can not access to the LLM.

So I move it down and it works now.

*force-pushed to change author