search

foldl / chatllm.cpp

Pure C++ implementation of several models for real-time chatting on your computer (CPU)
MIT License
357 stars 28 forks source link

baichuan13 does not work well #27

Open cagev opened 3 months ago

cagev commented 3 months ago 

ggml_opencl: selecting platform: 'NVIDIA CUDA'
ggml_opencl: selecting device: 'NVIDIA GeForce RTX 3080'
    ________          __  __    __    __  ___ (百川)
   / ____/ /_  ____ _/ /_/ /   / /   /  |/  /_________  ____  
  / /   / __ \/ __ `/ __/ /   / /   / /|_/ // ___/ __ \/ __ \ 
 / /___/ / / / /_/ / /_/ /___/ /___/ /  / // /__/ /_/ / /_/ / 
 \____/_/ /_/\__,_/\__/_____/_____/_/  /_(_)___/ .___/ .___/  
You are served by Baichuan,                   /_/   /_/       
with 13264901120 (13.3B) parameters.

You  > hi
A.I. >  Cond系统的悋 Mobile殍 finished看着饧了一下 rebell暂时☢ Junior这边那个頢 Tanztagال snake
foldl commented 3 months ago

GPU acceleration is not supported yet.