search

yineza7 / Summarization-of-a-stack-of-papers-using-LLMs-

Summarizing a stack of papers involves systematically reviewing and condensing the key information from each paper to provide a concise overview It might be feasible to have two stages to come out the summarization of a stack of papers.
MIT License
0 stars 0 forks source link

Evaluate the dataset and mimick the process for training #4

Open yineza7 opened 8 months ago

yineza7 commented 8 months ago

Understand how the datasets used in summarization work so that we may produce our own sets of samples

yineza7 commented 8 months ago

part 1: convert documents(pdf) to text part 2: Understand how the they csv and then mimick!

ColinThomas1 commented 8 months ago

Text Inputs for Practice Summarization.docx

ColinThomas1 commented 6 months ago

Potential issue, if the new dataset is still having issues summarizing, the word count being set to 512 could be an issue as the input is far greater than 512 words.