Closed abizard closed 3 weeks ago
I don't know of any steps that can be manualized, unfortunately.
Hello,
I hope this message finds you well. I am currently exploring the Lag-Llama model and I would like to gain a deeper understanding of the tokenization, feedforward, and backward processes within the model. Specifically, could you provide insights on how the tokenization, feedforward, and backward passes are handled in the implementation?
Are there any specific layers or methods in the model where these processes can be observed or logged?
Thank you for your assistance!
Are there any recommendations for steps that can be manualized in the model architecture? The manualization can be in the form of mathematical calculations.