Open NightMachinery opened 7 months ago
@simonw Bumping this; I am considering disabling token counting, but I am not sure if the culprit is really this.
Bumping this again.
ttok
seems to use HuggingFace, which is most probably the culprit. See this issue. I suspect some similar env flag must be set for offline usage.
ttok
either does not work or is very very slow when the internet connection is bad/non-existent. Is this a known design behavior or a bug?Related:
10