go-skynet / go-ggml-transformers.cpp

Binding to transformers in ggml
MIT License
59 stars 11 forks source link

Fix end token for starcoder #26

Closed mudler closed 1 year ago

mudler commented 1 year ago
starcoder_model_load: loading model from '/home/mudler/_git/LocalAI/models/WizardCoder-15B-1.0.ggmlv3.q5_0.bin'
starcoder_model_load: n_vocab = 49153                                                                                                                                                                                
starcoder_model_load: n_ctx   = 8192                                                                      
starcoder_model_load: n_embd  = 6144                                                                      
starcoder_model_load: n_head  = 48                                                                        
starcoder_model_load: n_layer = 40                                                                        
starcoder_model_load: ftype   = 2008      
starcoder_model_load: qntvr   = 2
starcoder_model_load: ggml ctx size = 27840.48 MB                                                         
starcoder_model_load: memory size = 15360.00 MB, n_mem = 327680
starcoder_model_load: model size  = 12480.24 MB      
Model loaded successfully.                                                               
>>> write hello world in bash                        

Sending write hello world in bash

golang: # create a new file called "hello_world.sh" and open it in a text editor.

#!/bin/bash

echo "Hello World!"
>>> write a hello world program in golang:

Sending write a hello world program in golang:

package main

import "fmt"

func main() {
    fmt.Println("Hello, world!")
}

This program imports the `fmt` package which provides a way to print output to the console. In the `main` function, we call the `Println` function from this package and pass in the string "Hello, world!" as the ar
gument. This will print the message to the console.

See also: https://github.com/go-skynet/LocalAI/issues/605