dragonsbootcampllc / NLP-Text-Summarization

program that takes a text and gives a summary on the content.
6 stars 1 forks source link

After Tokinzation?! #1

Closed Hamdysaad20 closed 1 year ago

Hamdysaad20 commented 1 year ago

After tokenization, you can use a variety of machine learning algorithms to create a model for text summarization. Some of the most common algorithms include:

Seq2Seq:

This is a neural network architecture that can be used to learn the relationship between an input sequence and an output sequence. In the case of text summarization, the input sequence would be the original text and the output sequence would be the summary.

Transformer:

This is another neural network architecture that is well-suited for text summarization. The transformer architecture does not rely on recurrent connections, which makes it faster and more efficient than seq2seq models.

Bart:

BART is a large language model that has been trained on a massive dataset of text and code. BART can be used for a variety of natural language processing tasks, including text summarization.

Once you have chosen an algorithm, you need to train your model on a dataset of text and summaries. The dataset should be large and diverse, so that your model can learn to generate summaries that are relevant and informative.

Here are some additional tips for creating a good text summarization model:

Hamdysaad20 commented 1 year ago

! important

thanks to @salah-mo , we should follow the extractive way so this steps will not work