search

athena-team / athena-decoder

Apache License 2.0
75 stars 26 forks source link

what does "inner_packed_states_array" mean? #7

Open HalFTeen opened 4 years ago

HalFTeen commented 4 years ago

I have seen the explanation: "inner states need to be record, type: tuple". Are there any other role except for recording the innner states？ Because I found it can still get the correct result without the parameter. looking forword to your reply. THX.

godjealous commented 4 years ago

The structure "inner_packed_states_array" is an interface for future expand.

Now, for Transformer model, this structure could be ignored because every token records full history labels. So, you could get correct results without the parameters.

However for other End-to-End models, for example LAS, it is useful to record some Intermediate state to avoid Repeated calculation