-
## 概要
GCNのみならず、GCN研究の遺産を活かし他グラフニューラルネットワークの実装の取り組みをしたい。
その点、GATは有力候補であり、これの実装に取り組む。
## 実装方針
- **`include/gat.h`、`src/gat.c`、`gat_prog.c`、`Makefile`のみの修正を原則とする**
- 必要に応じてファイル追加は構わないが、**既存の実装(`li…
-
As a beginner, I can't understand Fig3D graph attention weight calculation method. I can't find relevant information in the method and code of the article. May I ask how it was calculated? Or what mod…
-
python export_qwen2_1.5.py -m /media/yanxiao/机械硬盘1/LLM/Qwen2-7B-Instruct -o ./
WARNING:root:*** Note: please apply modications to model before conversion:
modication 1: in Qwen2ForCausalLM.forwar…
-
From now on, we recommend using our discussion forum (https://github.com/rusty1s/pytorch_geometric/discussions) for general questions.
## ❓ Questions & Help
Hi, I'd like to implement the funct…
-
Hi, I wonder if you could release the source code of your Message-Aware Graph Attention Network? I found your results very interesting.
-
## Description
When running inference with TensorRT's disentangled attention plugin on Microsoft's implementation of DeBERTa , I noticed that I get inconsistent output when running with dynamic seq…
-
### What
Lets' support RoPE (Rotary Position Embedding) and fuse
The image below is part of the token generation model.
This graph is fused with rope op.
![rope](https://github.com/user-…
-
## 🚀 Feature
[This paper in ICLR ](https://openreview.net/pdf?id=SJgxrLLKOE) describes a new attention mechanism for graph neural networks that builds off of the original multi-head attention for…
vymao updated
3 years ago
-
### OpenVINO Version
2023.3
### Operating System
Fedora Silverblue 39
### Device used for inference
GPU
### Framework
PyTorch
### Model used
llava-hf/llava-1.5-7b-hf
### …
-
I have a question about a use case of flex attention.
I am wondering if it is possible to write to some globally scoped tensor the way that the alibi bias example in the link above reads from a glo…