feat: token biases

[giladgd]

Description of change

• feat: token biases
• fix: bugs

Fixes #192

How to use TokenBias

Here is an example of to increase the probability of the word "hello" being generated and prevent the word "day" from being generated:

import {fileURLToPath} from "url";
import path from "path";
import {getLlama, LlamaChatSession, TokenBias} from "node-llama-cpp";

const __dirname = path.dirname(fileURLToPath(import.meta.url));

const llama = await getLlama();
const model = await llama.loadModel({
    modelPath: path.join(__dirname, "models", "dolphin-2.1-mistral-7b.Q4_K_M.gguf")
});
const context = await model.createContext();
const session = new LlamaChatSession({
    contextSequence: context.getSequence()
});

const q1 = "Hi there, how are you?";
console.log("User: " + q1);

const a1 = await session.prompt(q1, {
    tokenBias: (new TokenBias(model))
        .set("Hello", 1)
        .set("hello", 1)
        .set("Day", "never")
        .set("day", "never")
        .set(model.tokenize("day"), "never") // you can also do this to set bias for specific tokens
});
console.log("AI: " + a1);

Pull-Request Checklist

• [x] Code is up-to-date with the master branch
• [x] npm run format to apply eslint formatting
• [x] npm run test passes with this change
• [x] This pull request links relevant issues as Fixes #0000
• [ ] There are new or updated unit tests validating the change
• [ ] Documentation has been updated to reflect this change
• [x] The new commits and pull request title follow conventions explained in pull request guidelines (PRs that do not follow this convention will not be merged)

[github-actions[bot]]

:tada: This PR is included in version 3.0.0-beta.16 :tada:

The release is available on:

• npm package (@beta dist-tag)
• GitHub release
• v3.0.0-beta.16

Your semantic-release bot :package::rocket: