How to prevent trained model answering outside of domain

[MuhammadBilal848]

I have trained Llama3.1 and it is performing well but when I ask it a question outside of the domain it is answering it instead of avoiding the question.

Is there any workaround to this?

[danielhanchen]

If it's outside of domain, but you did not finetune it on anything, sadly it might have overfit - you could try averaging the finetuned weights with the general instruct model which might reduce this issue

[Ammar-Alnagar]

I suggest prompting it to avoid answering question outside your desired domain and provide an alternate response if asked about anything not related to the domain , you can also tell it to answer based only on the training data and try messing around with temperature value