tokenizers: bump version to 0.7.0

IBM / powerai

This repo contains ancillary information used to assist users of IBM Watson Machine Learning Community Edition. This repo will contain How To's, Readme's, Dockerfiles, etc. that can be consumed by users looking to get started.

BSD 2-Clause "Simplified" License

56 stars 54 forks source link

tokenizers: bump version to 0.7.0 #259

Closed hartb closed 4 years ago

hartb commented 4 years ago

Update huggingface/tokenizers from 0.6.0 to 0.7.0, and convert to common build scripts.