-
I can not get logging to work with unsloth, what am I doing wrong?
I'm doing the following:
args = TrainingArguments(
per_device_train_batch_size = batchSize,
per_device_…
-
**Describe the bug**
Running FP8 PTQ of Llama3-8b on 1x 4090 (24GB) goes OOM? Is this expected? vLLM FP8 quantization works on the same GPU.
What are the minimum requirements to run this quantizat…
-
May I know how are the model reported in the paper evaluated, or what are the exact evaluation commands?
Specifically, the model `open-instruct-pythia-6.9b-tulu` reports 33.4 F1 on TydiQA-GP, but w…
-
============== model pool evaluation =============
========================================================in model_pool_wrapper print dic_exp_conf
{'RUN_COUNTS': 3600, 'TRAFFIC_FILE': ['anon_6_6_3…
-
This is an issue to track who is using Kokkos. If you have an app you are working on feel free to add it below, if you are willing to be listed. We will put this eventually on our upcoming website.
…
-
Dear Ax Team,
I am currently trying to run a MOMF use case in the Service API; have been mostly consulting the BoTorch tutorials for this, and so far I have come up with the following repro that se…
-
Hi,
Could you please provide the code to run the frame prediction model on any video/sequence of frames?
I took at look at `eval` scripts, but there is a lot of code hardcoded to run on DAVIS ev…
-
# WIP
### Goals and Objectives
**Objective:** Develop and enhance the Theory section of Polykey’s documentation to provide users with in-depth theoretical knowledge that supports their understanding…
-
My code:
```
import typing as t
import asyncio
from typing import List
from datasets import load_dataset, load_from_disk
from ragas.metrics import faithfulness, context_recall, context_precisi…
-
I've see your https://github.com/NVIDIA/TensorRT/pull/3859
Is it possible to have on trt10?
I'm working on jetson agx Orin and now is compatible with cuda 12.5, cudnn 9.1.1 and tensorrt 10.0.1.6.
A…