Hello,
We are currently working on an NLP research project.
We have already obtained our way of preprocessing, such as give a long document a specified vector representer. So, what the training set now is a fixed length decimal vector, and the output should be different labels.
However, as far as I know, Passage has its own preprocessing methods, and is kind of "required" for a training input.
Could I have any way to reduce Passage's own preprocessing procedures?
such as tokenizer and Embedding layer.
Hello, We are currently working on an NLP research project. We have already obtained our way of preprocessing, such as give a long document a specified vector representer. So, what the training set now is a fixed length decimal vector, and the output should be different labels. However, as far as I know, Passage has its own preprocessing methods, and is kind of "required" for a training input. Could I have any way to reduce Passage's own preprocessing procedures? such as
tokenizer
andEmbedding
layer.For example the layers looks like this
So, is there any way to remove the first layer, so that the training inputs can directly go to RNN layers.
Well, if I do so, it will, of course, give error msg:
Thank you.