-
## problem description:
Hi! While training the original code using deepseek-ai/deepseek-coder-7b-base-v1.5 as base model on 8 A100 GPUs, I encountered the OOM issues below:
`Traceback (most recent c…
-
https://www.tensorflow.org/model_optimization/guide/pruning/pruning_with_keras
-
I am working on a regression problem where I am attempting to use UMAP for supervised feature embedding, and use the resulting low-dimensional embeddings as input variables of a subsequent regression …
-
I have a trained PyTorch model, and when I export it to onnx with `static shapes` in `fp16` and with default `all optimizations enabled` by ort.GraphOptimizationLevel.ORT_ENABLE_ALL.
When I compare …
-
Is there a built-in way to do checkpointing on the Bayesian optimization using the GP surrogate and later recover its state, if say the application unexpectedly terminates?
One possible way could b…
-
while trying to run https://github.com/google-research/google-research/blob/master/kws_streaming/colab/02_inference.ipynb, i get :
```
---------------------------------------------------------------…
-
(base) root@e9f21ccb6520:/workspace/apex/examples/simple/distributed# bash run.sh
Selected optimization level O1: Insert automatic casts around Pytorch functions and Tensor methods.
Defaults for…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits of both this extension and the webui
### What happened?
![01-fs8](https://gi…
-
What is the resource requirement of the deployed model? Explain the resources defined for the model pod.
What is the throughput of the model? How can we increase the throughput?
Given a combinat…
-
# Problem
Transfer model from pytorch to onnx by torch.onnx.dynamo_export failed.
These failed occured when array slicing inside model and set torch.onnx.ExportOptions(dynamic_shapes=True), it can run…