mudler / LocalAI

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
https://localai.io
MIT License
26.46k stars 1.98k forks source link

fix(p2p): parse correctly ExtraLLamaCPPArgs #4220

Closed mudler closed 1 week ago

mudler commented 1 week ago

Previously we were sensible when args aren't defined and we would clash parsing extra args.

Description

This PR fixes #4214

This pull request includes an important change to the Run function in the worker_p2p.go file. The change ensures that the extraArgs variable is properly initialized and adds a debug log statement to provide better visibility into the arguments being used when starting the llama-cpp-rpc-server.

Initialization and logging improvements:

Notes for Reviewers

Signed commits

netlify[bot] commented 1 week ago

Deploy Preview for localai ready!

Name Link
Latest commit 82c094a1c0053d960c22fe2bab89299049364031
Latest deploy log https://app.netlify.com/sites/localai/deploys/673f3f8481e4550008554480
Deploy Preview https://deploy-preview-4220--localai.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.