search

open-mol / bioagent

Apache License 2.0
0 stars 0 forks source link

Add Multiple Modality Support #4

Open CiaoHe opened 2 months ago

CiaoHe commented 2 months ago

Description

目前仅支持2d molecule GNN node feature (无论是train / test). 未来的版本中需要集成multiple features (1D / 2D / 3D)

Plan

  1. 做multi-modality fusion encoder module, 在concat with text token之前就完成多种模态的fusion
  2. 把单个instance的多个模态encoded features按照token length顺序进行concat

Priority