search

AndyJZhao / HGSL

Source code of AAAI21-Heterogeneous Graph Structure Learning for Graph Neural Networks
Apache License 2.0
111 stars 18 forks source link

Adaption #2

Closed bourne-3 closed 3 years ago

bourne-3 commented 3 years ago

Your job is great. I would like to ask if this method is suitable for multimodal sentiment analysis?(There exist three modality, eg Audio, text and video.And the data appear heterogeneous nature)

AndyJZhao commented 3 years ago

Thank you for the kind words. However, for simplification, HGSL is designed to handle the common case of a heterogeneous graph, where a heterogeneous graph is composed of multiple types of nodes and links (with one modality of feature for each type). Nevertheless, if you are trying to mine the potential graph structure generated by intra- and inter-modality of node features, a possible way is to design different metric learning layers and apply channel attention for aggregation.