-
I am using Anaconda to build my own project. I am using Python version 3.10.14 and downloaded Ollama, pulled Mistral for my LLM, and pulled Nomic-Embed-Text for my embedding model. I followed the inst…
-
:red_circle: **Title** : Automated Essay Scoring System
:red_circle: **Aim** : Create a system to automatically score essays using NLP techniques.
:red_circle: **Brief Explanation** :
- Colle…
-
May I ask if this implementation of the model has been experimented on the MEL spectrum.? I used
Transformer model with only convolutional positional coding added at the beginning to get discontinuou…
-
# Reference
- [ ] [paper - 2019 - A Simple and Strong Convolutional-Attention Network for Irregular Text Recognition](https://arxiv.org/pdf/1904.01375v3.pdf)
- [ ] [paper - 2017 - Attention Is All Y…
-
Hello
I read your article. In the article, you said that you used **Hypergraph Transformer**, but I did not find the Transformer section in my code.
You only wrote the last function in TensorFlow …
-
I guess the optimizer choice should be either LARS or LAMB based on the encoder (convolutional/transformer). Isn't it?
-
-
-
Hi,
I was wondering, why use WordConv (separable convolution) in NL encoder and not the usual Feedforward NN (like original transformer)? Is it mainly because separable conv is easier to train? Did…
-
I am trying to lower GPT2 model to linalgIR but I am running into errors. I have built torch_mlir from source and have installed transformers with the latest version: pip install git+https://github.co…