search

open-mmlab / mmskeleton

A OpenMMLAB toolbox for human pose estimation, skeleton-based action recognition, and action synthesis.
Apache License 2.0
2.92k stars 1.03k forks source link

about the Temporal Part in st-gcn #88

Closed YanYan0716 closed 6 years ago

YanYan0716 commented 6 years ago

@yysijie @yjxiong hello, thank you for your sharing about the network, as a new student in this field, I want to ask you "how to add the temporal information in the graph ? " in the graph.py, i only saw the adjacency matrix about the 18 points in openpose, but i don't know your method to add the temporal information in the graph, could you give me some advice, of course as a beginner,i am looking for your reply, thanks again

yysijie commented 6 years ago

In our implementation, we followed the idea of separable convolutions. We used a common 1d convolution to process the temporal information (a joint track) and a graph convolution to process spatial information (a human skeleton in a frame).

You can also process them simultaneously. Please refer to https://github.com/yysijie/st-gcn/blob/master/net/utils/tgcn.py. ConvTemporalGraphicalis the graph convolution layer we used. You can assign t_kernel_size parameter to modify the kernel size in the time dimension. The default value is 1.

YanYan0716 commented 6 years ago

thanks a lot, i will see the code again.