search

The-FinAI / CALM

A LLM training and evaluation benchmark for credit scoring
MIT License
30 stars 3 forks source link

Can you provide the instruction and chat template for this model? #4

Open Rithu722 opened 3 months ago

colfeng commented 3 months ago

No description provided.

You can refer to the link for the specific data format.

https://github.com/Dai-shen/CALM-train

Rithu722 commented 3 months ago

I could view the data there but not the prompt template

Actually, I am trying to load using oobabooga and wish to have a conversation with this model. It shows typing but gives empty response. I figured out that chat template must be the issue which oobabooga isnt able to interpret. So what is the instruction and chat template for the same?

colfeng commented 3 months ago

I could view the data there but not the prompt template

Actually, I am trying to load using oobabooga and wish to have a conversation with this model. It shows typing but gives empty response. I figured out that chat template must be the issue which oobabooga isnt able to interpret. So what is the instruction and chat template for the same?

If you want to test the model, you can input the value of the "query" in our evaluation datasets for the LLM, such as German Credit Scoring(https://huggingface.co/datasets/daishen/cra-german).

By the way, our model does not support the multi-turn conversation.

colfeng commented 3 months ago

I could view the data there but not the prompt template

Actually, I am trying to load using oobabooga and wish to have a conversation with this model. It shows typing but gives empty response. I figured out that chat template must be the issue which oobabooga isnt able to interpret. So what is the instruction and chat template for the same?

I also suggest that you can use our model under the transformer framework without oobabooga to confirm if it can answer the "query". This may help you verify whether the issue is related to oobabooga.