PETR Model Card - Githubissues

tenstorrent / tt-metal

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

https://docs.tenstorrent.com/ttnn/latest/index.html

Apache License 2.0

488 stars 80 forks source link

PETR Model Card #14296

Open HariniMohan0102 opened 1 month ago

HariniMohan0102 commented 1 month ago

Torch reference: https://github.com/open-mmlab/mmdetection3d/tree/main/projects/PETR

Torch graphs: Transformer module: model_petr_transformer.gv.pdf VovNetCP module: model_vovnetCP.gv.pdf

PETR Modules:

Det3DDataPreprocessor
PETRHead
- PETRTransformer
  - PETRTransformerDecoder
    - PETRTransformerDecoderLayer
      - MultiheadAttention
      - PETRMultiheadAttention
      - FFN
VoVNetCP
- _OSA_stage
- _OSA_Module
  - Hsigmoid
  - eSEModule
CPFPN

Setup Instructions: PETR Model Setup

Unit tests Branch: VovNetCP Module Unit tests: harini/petr_vovnetcp_unittests Transformer modulr unit tests: keerthanar/petr_transformer_unittest

Ops:

Conv2d
ReLU6
ReLU
MaxPool2d
AdaptiveAvgPool2d
Linear
layernorm
Multiheadattention

HariniMohan0102 commented 1 month ago

cc: @punithsekar @keerthana-r-mcw