How to implement this type of "Transformer" machine learning model with the "rindow-neuralnetworks" Package ???

[chegmarco1989]

Hi.

Please, we don't see in the documentation of rindow/rindow-neuralnetworks, the implementation of the Transformer machine learning model ( https://en.wikipedia.org/wiki/Transformer_(machine_learning_model) ).

So how to implement this type of Transformer machine learning model in PHP with the rindow/rindow-neuralnetworks Package ???

Thank you for directing us or giving us the link of the documentation that explains it. Awaiting your reply.

[yuichiis]

Hi

I have never implemented a transformer.

Here's how to create a custom model.

• https://rindow.github.io/neuralnetworks/custommodel.html

An example implementation of transformer by tensorflow is below

• https://www.tensorflow.org/text/tutorials/transformer

Please let me know if you can implement it.

However, there are still few functions that can be used for automatic differentiation, so “rindow” may not have enough functions.