Open sidoncloud opened 10 months ago
Understood, I am new to this repo but an LLM enthusiast. I can try some reproduction and triage based on a specific use case and code specific run you encountered. Here to help.
I faced similar rai_issues even with private data. It marked when I had a person's name or asked about going to a specific bank website. It went away once I removed those samples from my jsonl file. So, unless these examples were crucial, you could try removing them.
Like most of the code uploaded by Google developers , your model tuning code that uses the stackoverflow data fails miserably giving the below errors.