Closed ZachNagengast closed 5 months ago
Allows tokenizer to be loaded from disk if it has already been downloaded previously. Resolves #81
Also includes linting across the project, and some minor fixes for logprob indices and timings
Allows tokenizer to be loaded from disk if it has already been downloaded previously. Resolves #81
Also includes linting across the project, and some minor fixes for logprob indices and timings