search

goru001 / inltk

Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need
https://inltk.readthedocs.io
MIT License
818 stars 164 forks source link

Dimensionality Reduction #81

Closed RAJAN8553 closed 2 years ago

RAJAN8553 commented 2 years ago

Yes now i understood Thank you @goru001. Can I tweak that hyperparameter as i need less dimensional or I have to apply feature extraction method. Can you suggest good feature extraction method for your model.

Should I reduce the dimension of the data(as the model is giving out 400 vectors for a single sentence). Size of my data is 600(rows, Gujarati language) and after getting 400 vectors for each sentence the total size will be 600x400 which is a huge data to handle.

goru001 commented 2 years ago

Hi @RAJAN8553 , you can reduce the dimensionality using PCA or similar algos.

goru001 commented 2 years ago

Closing this issue for now. Feel free to reopen if there's anything else. Thanks!