Closed lixin716 closed 1 year ago
hello, I am reading your code,nice work! and I do not know how to get the topk locations in the model.
And I also want to know the meaning of the state_dict,like MultiEmbed.emb_t.weight,MultiEmbed.emb_su.weight,Attn.emb_loc.weight and so on.
Thanks,
@yingtaoluo
These are pytorch specified languages. You can search for topk function of numpy or torch. weight here means learnable parameters...
hello, I am reading your code,nice work! and I do not know how to get the topk locations in the model.
And I also want to know the meaning of the state_dict,like MultiEmbed.emb_t.weight,MultiEmbed.emb_su.weight,Attn.emb_loc.weight and so on.
Thanks,