Closed aymane-eljerari closed 3 months ago
Hi @aymane-eljerari. Looks to me like this is an issue with your application launch parameters
Please verify and first confirm that the application runs before profiling with Omniperf. If your issue persists, please re-open this ticket.
See #383. I believe encapsulating your application arguments in a wrapper script could also be a potential solution.
Describe the bug I am unable to profile my workload.
Development Environment:
To Reproduce Steps to reproduce the behavior:
omniperf profile -V -n llama3 -k dequantize_mul_mat_vec -- ./llama.cpp/llama-cli -m llama.cpp/models/llama3/Meta-Llama-3-8B-Instruct/ggml-model-f16.gguf -ngl 50 -n $num_tokens -c $context --prompt $user_prompt
See command output and error below:
Expected behavior I expect omniperf to run without any errors.
Screenshots If applicable, add screenshots to help explain your problem.
Additional context The command below shows that my omniperf installation is correct.