A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
2024-08-27T15:08:11.595Z INFO [ai00_server] ai00_server version: 0.4.8
2024-08-27T15:08:11.604Z INFO [ai00_server] server started at 127.0.0.1:8000 without tls
2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] loading model "./ai00_server/assets/models/RWKV-x060-World-1B6-v2.1-20240328-ctx4096.st"
2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] ModelInfo {
version: V6,
num_layer: 24,
num_emb: 2048,
num_hidden: 7168,
num_vocab: 65536,
num_head: 32,
time_mix_adapter_size: 32,
time_decay_adapter_size: 64,
}
2024-08-27T15:08:11.667Z INFO [ai00_server::middleware] type: SafeTensors
ai00_server 已经更新到0.5.6 尝试直接改名替换文件发现启动模型失败
2024-08-27T15:08:11.595Z INFO [ai00_server] ai00_server version: 0.4.8 2024-08-27T15:08:11.604Z INFO [ai00_server] server started at 127.0.0.1:8000 without tls 2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] loading model "./ai00_server/assets/models/RWKV-x060-World-1B6-v2.1-20240328-ctx4096.st" 2024-08-27T15:08:11.666Z INFO [ai00_server::middleware] ModelInfo { version: V6, num_layer: 24, num_emb: 2048, num_hidden: 7168, num_vocab: 65536, num_head: 32, time_mix_adapter_size: 32, time_decay_adapter_size: 64, } 2024-08-27T15:08:11.667Z INFO [ai00_server::middleware] type: SafeTensors