What is the difference between the 'forward' mode and the 'generate' mode?

MrYxJ / calculate-flops.pytorch

The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer(Bert、LlaMA etc Large Language Model)

https://pypi.org/project/calflops/

MIT License

508 stars 16 forks source link

What is the difference between the 'forward' mode and the 'generate' mode? #20

Open AboveParadise opened 6 months ago

AboveParadise commented 6 months ago

What is the difference between setting the parameter 'forward_mode' in function calculate_flops() as 'generate' and setting it as 'forward' (default)?

liut89 commented 3 months ago

Same asking