search

intel / intel-extension-for-pytorch

A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
Apache License 2.0
1.56k stars 237 forks source link

Can you provide me with a prompt.json file template #695

Open zwx109473 opened 3 weeks ago

zwx109473 commented 3 weeks ago

Describe the issue

I'm using intel-extension-for-pytorch model inference. Can you provide me with a prompt.json file template?

with open(str(current_path) + "/prompt.json") as f: FileNotFoundError: [Errno 2] No such file or directory: '/inter-for-pytorch/single_instance/prompt.json' LLM RUNTIME ERROR: Running generation task failed. Quit.

feng-intel commented 3 weeks ago

How about this one: https://github.com/intel/intel-extension-for-pytorch/blob/release/xpu/2.1.40/examples/gpu/inference/python/llm/prompt.json