Improve training and dataset generation scripts - Githubissues

EveripediaNetwork / issues

Issues repo

9 stars 0 forks source link

Improve training and dataset generation scripts #2656

Closed brunneis closed 4 months ago

brunneis commented 4 months ago

Dataset generation:

Use GPT4o
Update prompt to improve data quality

Training:

Multi-class evaluation
Fix training loop with hyperparameters iteration
Improve evaluation function
Reduce classes to vulnerable and non-vulnerable to improve effectiveness
Add a curated list of models to the training loop with smaller memory footprint than deepset/xlm-roberta-base-squad2-distilled:

deepset/minilm-uncased-squad2
intfloat/e5-base-v2
intfloat/e5-small-v2
microsoft/deberta-base
deepset/roberta-base-squad2-distilled
deepset/tinybert-6l-768d-squad2
deepset/tinyroberta-6l-768d
deepset/tinyroberta-squad2

brunneis commented 4 months ago

https://github.com/EveripediaNetwork/iq-code-supervisors/pull/1 https://github.com/EveripediaNetwork/iq-code-supervisors/pull/2