-
I try to use real and dummy weights to build bloom 176b model, but all failed with Integer Overflow.
build command:
```bash
# real weights
python build.py --world_size 8 \
--mod…
-
In the rotation process, why don't you apply rotations in the float64 version first and float16 again instead of only applying float16 version at once?
-
## Description
I attempted to compile a Hugging Face model (the Hugging Face model link is: https://huggingface.co/OpenGVLab/InternViT-6B-448px-V1-5, which includes both the model architecture code …
-
Hi,im trying to adapt the Vader to dynamicrafter, but I facing some bug when **accelerator.backward(loss)**,here is the error,.
`torch.utils.checkpoint: Recomputed values for the following tensors ha…
-
I have successfully built and started docker container for tensorrt_llm and ran the convert_checkpoints.py as well as trtllm_build as follows:
1. docker run -it --net host --shm-size=4g --name triton…
-
**What I would like to be added**
I would like to see numpy's float16 added to Pyccel's supported data types.
I only need it for data storing, all mathematical operations will be done in float32 t…
-
Float16 or bfloat16 support for loads and stores is missing. I do not expect SIMD extensions to actually do operations on them in native format in hardware (but it would be nice to expose that and emu…
-
docker img: registry.mthreads.com/mcconline/musa-pytorch-dev-public:rc3.1.0-v1.3.0-S4000-py38
musa_toolkit: rc3.1.0
```python
import torch
import torch_musa
input_ = torch.ones(16384, 4096).t…
-
When I use the command "
python demo_txt2img_flux.py prompt \
--version "flux.1-dev" \
--int8 \
" run the code, the engine file size is the same with float16, how to solve the problem?
-
How can create And send TX like this:
Full name: uavcan.equipment.power.BatteryInfo
Default data type ID: 1092
------------------------------------------------------------------
#
# Single b…