THUDM / CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model
https://codegeex.cn
Apache License 2.0
7.6k stars 536 forks source link

langchain如何调用? #98

Open mjmjmmmjjj opened 10 months ago

mjmjmmmjjj commented 10 months ago

我相信langchain是可以调用的,给一个例子?

GY13752426624 commented 10 months ago

from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("改成模型路径", trust_remote_code=True) model = AutoModel.from_pretrained("改成模型路径", trust_remote_code=True, device='cuda') model = model.eval()

remember adding a language tag for better performance

prompt = "# language: Python\n# write a bubble sort function\n" inputs = tokenizer.encode(prompt, return_tensors="pt").to(model.device) outputs = model.generate(inputs, max_length=256, top_k=1) response = tokenizer.decode(outputs[0])

print(response) 可以看看官网 https://huggingface.co/THUDM/codegeex2-6b