search

mgonzs13 / llama_ros

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2
MIT License
155 stars 27 forks source link

Create stablelm.launch.py #4

Closed smellslikeml closed 10 months ago

smellslikeml commented 10 months ago

I love the project and thought our 3B fine-tune could be a speedy option.

Adds launch file to run stablelm-zephyr-3b LoRA from https://huggingface.co/remyxai/stablelm-zephyr-3B_localmentor

image

mgonzs13 commented 10 months ago

Hey @smellslikeml, thanks for the work.