-
hi there, I am using a 8Gen3(Xiaomi14 Pro 68GB/s bw) and following the Android Cross Compilation Guidance Option.1: Use Prebuilt Kernels guide to test llama-2-7b-4bit token generation performance.
it…
-
Hello,
I am trying to use [Ultra-Light-Fast-Generic-Face-Detector-1MB](https://github.com/Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB/tree/master) model in my app.
I have converted the onn…
-
### What Feature?
AV1 decode is currently exposed in vainfo on supported HW, but the decoding itself fails if the media-driver is built without any kernels (neither free nor non-free), supposedly bec…
-
**Describe the bug**
Unable to find the rebuild driver for kernel `5.10.217-205.860.amzn2.x86_64` on AWS EKS version 1.26.
Download link : https://download.falco.org/driver/5.0.1%2Bdriver/x86…
-
I'm currently building the project for my laptop (Ryzen 4700U) but the integrated GPU is not officially supported.
For now I've been able to successfuly build until rocBLAS but as the device is unsup…
-
I am facing error, `AWQ kernels could not be loaded. `with autoawq==0.2.4.
- image nvcr.io/nvidia/pytorch:23.10-py3
- Python 3.10
- cuda 12.2.2
- torch 2.1.0a0+32f93b1
Build and install f…
-
I'm trying to install the lab extension for JupyterLab v4.0.5 with the command:
```bash
$ jupyter labextension install jupyterlab-plotly
(Deprecated) Installing extensions with the jupyter labex…
-
### Problem
I use virtual environments (via conda) to manage the Python packages I have installed for different projects. I have a separate JupyterLab environment, and use [nb_conda_kernels](https:…
-
### Package and Environment Details
* Package Name/Version: **embree3/3.13.3**
* Operating System+version: **Linux Ubuntu 22.10**
* Compiler+version: **clang 14**
* Conan version: **conan 1.51.2**…
-
Great work!
I am trying to do inference speedup. Could you please share the code for inference speedup using 2:4 sparsity on Ampere GPUs? Thanks!