facebookincubator AITemplate issues

facebookincubator / AITemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

Apache License 2.0

4.54k stars 363 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Added a 'use cases' section

#1029 chillinturt opened 1 week ago
1
Update default CUDA version to 12.4

#1028 zhuhan0 opened 1 week ago
1
FileNotFoundError: [Errno 2] No such file or directory: \\ComfyUI\\custom_nodes\\AITemplate-main\\__init__.py'

#1027 DuckersMcQuack opened 2 weeks ago
0
Allow Passing in Size of Dynamic Dimensions to Inference Function

#1025 oniononion36 closed 3 weeks ago
3
Called SetConstant on， but can't find in either bound or unbound constant set

#1024 ADongGu opened 3 weeks ago
0
Add reciprocal operator

#1023 muchulee8 closed 1 month ago
3
Use the full header file path to fix the build

#1022 hl475 closed 1 month ago
4
Grouped Transposed Convolutions cutlass errror

#1021 jonpryai opened 1 month ago
0
Process separate q/k/v weights in MHA converter

#1020 aakhundov closed 1 month ago
2
Make V100 tests runnable on {A,H}100 in Sandcastle CI

#1019 aakhundov closed 1 month ago
2
Prevent erroneous deduping of the full op

#1018 aakhundov closed 1 month ago
3
Add max_acc_splits

#1017 qxy11 closed 1 month ago
8
Del using namespace aitemplate/AITemplate/static/include/kernels/mem_eff_attention/kernel_forward.h

#1016 r-barnes opened 2 months ago
1
add eager mode check for NaN and Inf

#1015 frank-wei closed 2 months ago
2
Del using namespace aitemplate/AITemplate/static/include/kernels/mem_eff_attention/kernel_forward.h

#1014 r-barnes opened 2 months ago
1
add cuda_graph for mts_gpu_benchmark

#1012 frank-wei closed 2 months ago
6
Handle size-0 output for split

#1011 muchulee8 closed 3 months ago
2
allow concatenating empty tensors

#1010 chenyang78 closed 3 months ago
6
Confused on the shape of input Tensor

#1009 ningmenghongcha closed 3 months ago
7
Use torch.all to check tensor equality

#1008 22quinn closed 4 months ago
2
c10::optional -> std::optional in aiplatform/distributed_inference/pytorch/ops/tests/distributed_inference_operators_test_fixture.h +20

#1007 r-barnes closed 4 months ago
2
Fix minimizer tests

#1006 zejunh closed 4 months ago
3
standalone find_batch_size_dim

#1005 hl475 closed 5 months ago
7
Range operator lowering minimizer

#1004 frank-wei opened 5 months ago
1
include cstdint for int*_t in profiler

#1003 chengscott opened 5 months ago
4
Disable AITModel in fx2ait on AMD

#1002 zoranzhao opened 5 months ago
0
Update OSS black linter version to 24.4.0

#1001 aakhundov closed 5 months ago
6
Skip fuse_mm_elementwise fusion with model output in the middle

#1000 aakhundov closed 5 months ago
5
model_interface.cu:231: Error: Constant pretrained_model_patch_embed_proj_weight was not set! Set the value with set_constant.

#999 ADongGu closed 6 months ago
1
Got cutlass error: Error Internal at: 214

#998 syntrive closed 6 days ago
2
Docker image fails to build due to python dependency issue

#997 M1kep opened 6 months ago
2
Fixed a couple of dynamic shape detection issues

#996 chenyang78 closed 6 months ago
5
Does Concatenate order matters?

#995 ecilay opened 7 months ago
1
Add floor op

#994 henryhu6 opened 7 months ago
3
Add log1p elementwise op

#993 22quinn opened 7 months ago
5
ait: Explicitly throw when indexing a boolean tensor for masking

#992 kflu closed 7 months ago
7
Model is successfully compiled, but OOM when loading

#991 jiangwei221 opened 7 months ago
0
windows platform cannot link _binary_constants_bin_end and _binary_constants_bin_start

#990 joye closed 7 months ago
5
Extend int dtype with uint8 to skip lowering uint8-input ops in AIT splitter

#989 zoranzhao closed 8 months ago
2
multi-gpu at runtime error

#988 ecilay opened 8 months ago
4
allow binary ops where only one arg is an immutable IntVarTensor

#987 bradleyhd closed 8 months ago
5
add support for permute call with tuple args

#986 bradleyhd closed 8 months ago
4
allow type promotions from bool if common type is non-bool

#985 bradleyhd closed 8 months ago
4
fbcode//aitemplate/AITemplate

#984 bajanduncan closed 8 months ago
3
Does AIT handle if/else in forward function?

#983 jiangwei221 opened 8 months ago
1
AIT softmax fix

#982 zoranzhao closed 9 months ago
3
`Unsupported workload for this conv2d specialization` when using dynamic shape together with permute

#981 jiangwei221 closed 9 months ago
6
gcc: internal compiler error

#980 jiangwei221 closed 9 months ago
2
add avg_pool3d converter

#979 colinchan15 closed 9 months ago
3
aitemplate/AITemplate

#978 zsol closed 9 months ago
2