search

ICL-ml4csec / VulBERTa

Simplified Source Code Pre-Training for Vulnerability Detection
MIT License
76 stars 26 forks source link

imported BpeTrainer to train the tokenizer #5

Closed gurubhandari closed 1 year ago

gurubhandari commented 1 year ago

The last cell of the notebook was missing BpeTrainer. 'from tokenizers.trainers import BpeTrainer'