search

IDEA-FinAI / ToG

This is the official github repo of Think-on-Graph. If you are interested in our work or willing to join our research team in Shenzhen, please feel free to contact us by email (xuchengjin@idea.edu.cn)
238 stars 26 forks source link

The question regarding local deployment of large-scale models #26

Open jialinhappy opened 2 months ago

jialinhappy commented 2 months ago

Hello, I noticed that your interface can only be based on llama or gpt. If I want to deploy some local variants based on llama, such as qwen or yi, how can I use them?

GasolSun36 commented 2 months ago

Hello, I noticed that your interface can only be based on llama or gpt. If I want to deploy some local variants based on llama, such as qwen or yi, how can I use them?

Hi, You can refer to the official implementation code to complete this task. It should be relatively simple. We only implemented the version using llama and gpt.