-
When `torch.load` a `.pt` tensor file generated in R to python it fails:
`UnpicklingError: invalid load key, '\x1f'.`
-
Hi, I'm very interested by this awesome project. I wish to customize it for my own project but I have some questions and issues.
I want to understand how to make prediction under TensorflowJs.
First…
-
The following code loads BERT Large model from TF Hub, and tries to convert using TF-TRT.
```python
import os
os.environ["TF_CPP_VMODULE"]="trt_engine_utils=2,trt_engine_op=2,convert_nodes=2,conv…
-
Is it due to mel.n_len3000 that is the max of a single inference? If you feed some of the longers samples that whisper.cpp uses I presume its the mel.n_len3000 max as know they are much longer.
``…
-
**Describe the bug**
I am attempting to run the LLaMA2 demo at https://github.com/openvinotoolkit/model_server/blob/main/demos/llama_chat/python/README.md. When I run:
``` sh
python client.py -…
-
I've been struggling with trying to get this to compile for days. (Well there are so many errors I've gotten it probably wouldn't be useful to list them all.) But it seems like tensorflow_serving uses…
-
I'm planning to do NER with the Bert model. Unfortunately there is no sample provided for such a task. After inspecting the code for a while I have an okayish understanding of the model.
From my und…
-
### 1. System information
- OS Platform and Distribution: Ubuntu 22.04
- TensorFlow installation (pip package or built from source): pip
- TensorFlow library (version, if pip package or github SH…
-
```python
try:
# Colab only
%tensorflow_version 2.x
except Exception:
pass
import tensorflow as tf
from tensorflow.keras.layers import Conv2D
from tensorflow.keras.layers import De…
-
### Your current environment
Using latest available docker image: vllm/vllm-openai:v0.5.0.post1
### 🐛 Describe the bug
I am getting as response "Internal Server Error" when calling the /v1/embedd…