Closed BugaoxingXXX closed 1 month ago
@BugaoxingXXX please remember to chmod +x the llm-starter script. also use this : ./llm-miner-starter.sh dolphin-2.9-llama3-8b --miner-id-index 0 --port 8000 --gpu-ids 0 this starts the llm miner with model : dolphin-2.9-llama3-8b , considering eth-address-0 in .env, on port 8000, on gpu-0.
please try this out and let me know if this works!
from the image , the script has excute permission
and the command ./llm-miner-starter.sh dolphin-2.9-llama3-8b --miner-id-index 0 --port 8000 --gpu-ids 0
also has same problem
@BugaoxingXXX please remember to chmod +x the llm-starter script. also use this : ./llm-miner-starter.sh dolphin-2.9-llama3-8b --miner-id-index 0 --port 8000 --gpu-ids 0 this starts the llm miner with model : dolphin-2.9-llama3-8b , considering eth-address-0 in .env, on port 8000, on gpu-0.
please try this out and let me know if this works!
Hi @BugaoxingXXX https://github.com/heurist-network/miner-release/pull/55 fixes this issue. closing this.
hi, while run ther miner on 4090 with
dolphin-2.9-llama3-8b model
, an error accouredthe 182 line in
/root/miner-release/llm-miner-v1.1.1.py
is :and the
get_metric_value
function inllm_mining_core/utils/requests_utils.py
is :I think the reason is the
/metric
route not start while model load , the start log shows these routes :my start command is
./llm-miner-starter.sh dolphin-2.9-llama3-8b --port 8000 --gpu-ids 0
after miner start ,curl localhost:8000/metrics/
showsthere is only these routes while starting , pls check wheater this is some problem white starting miner