I am running codellama and llama3 locally.
I am chatting in Cody AI with llama3 and at certain point of time I cannot chat more - see screenshots below, there is an explanation on one of them of what is happening.
(base) ihor@monster:~$ ollama ps
NAME ID SIZE PROCESSOR UNTIL
llama3:latest 365c0bd3c000 5.4 GB 100% GPU 3 minutes from now
This is what is happening to my GPU now. Note: it was working while I was asking previous questions, I saw spikes. But now it is not doing anything:
Extension version: 1.20.0
VS Code version: Code 1.89.1 (dc96b837cf6bb4af9cd736aa3af08cf8279f7685, 2024-05-07T05:16:23.416Z)
OS version: Linux x64 6.4.6-060406-generic
Modes:
System Info
Item
Value
CPUs
Intel(R) Xeon(R) CPU E5-2696 v4 @ 2.20GHz (88 x 1197)
This issue is marked as stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed automatically in 5 days.
Type: Bug
I am running codellama and llama3 locally. I am chatting in Cody AI with llama3 and at certain point of time I cannot chat more - see screenshots below, there is an explanation on one of them of what is happening.
This is what is happening to my GPU now. Note: it was working while I was asking previous questions, I saw spikes. But now it is not doing anything:
Extension version: 1.20.0 VS Code version: Code 1.89.1 (dc96b837cf6bb4af9cd736aa3af08cf8279f7685, 2024-05-07T05:16:23.416Z) OS version: Linux x64 6.4.6-060406-generic Modes:
System Info
canvas_oop_rasterization: disabled_off direct_rendering_display_compositor: disabled_off_ok gpu_compositing: enabled multiple_raster_threads: enabled_on opengl: enabled_on rasterization: enabled raw_draw: disabled_off_ok skia_graphite: disabled_off video_decode: enabled video_encode: disabled_software vulkan: disabled_off webgl: enabled webgl2: enabled webgpu: disabled_off| |Load (avg)|1, 1, 1| |Memory (System)|251.76GB (236.44GB free)| |Process Argv|--crash-reporter-id 27d42247-63fb-4d9e-9cb0-87d9974843dc| |Screen Reader|no| |VM|50%| |DESKTOP_SESSION|ubuntu-xorg| |XDG_CURRENT_DESKTOP|Unity| |XDG_SESSION_DESKTOP|ubuntu-xorg| |XDG_SESSION_TYPE|x11|
A/B Experiments