Open harryhan1989 opened 1 month ago
Compiling tokenizers v0.12.1 会出错 error: casting &T to &mut T is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell
&T
&mut T
@harryhan1989 感谢关注,请问你是macOS吗?
windows 10
我们之前在macOS中也遇到过tokenizers的问题,通过降级transformer解决了,您可以尝试降级到2.x的版本。
如果安装实在有困难可以考虑下载windows一键安装包,我们已经把编译好的的环境打包进去了,可以像conda一样启动。
Compiling tokenizers v0.12.1 会出错 error: casting
&T
to&mut T
is undefined behavior, even if the reference is unused, consider instead using an `UnsafeCell