feat: Finetune Mask Model

Dijital-Twin / model

0 stars 0 forks source link

feat: Finetune Mask Model #2

Closed emirsoyturk closed 5 months ago

emirsoyturk commented 6 months ago

Goal

We wonder that can we generate sentence to prompt using different LLM like GPT4. Then change couple words in that sentence using MASK model so as a last result sentence is going to be converted to persona's style.

Steps

[ ] Fine tune a text model
[ ] Test that model using couple sentences and observe how does it works
[ ] Report the results. If this makes more sentence than QA model logic we can use this

emirsoyturk commented 5 months ago

Result is not promising. Fine tuned MASK model can fill [MASK] with words that has no relation with context sometimes.