Closed rohanwinsor closed 1 month ago
This PR addresses an oversight in the LlamaTokenizer class by changing the constructor argument from filepath to tokenizer_file. This correction clarifies the purpose of the argument and enhances code readability.
Check out this pull request on
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
This PR addresses an oversight in the LlamaTokenizer class by changing the constructor argument from filepath to tokenizer_file. This correction clarifies the purpose of the argument and enhances code readability.