create a unit test for the convert function

UD3-Lab / mintEMU

mintEMU - The Legacy of the European Postgraduate Master in Urbanism at TU Delft: A Text Mining Approach

Other

1 stars 0 forks source link

create a unit test for the convert function #80

Closed alwil closed 1 year ago

alwil commented 1 year ago

[ ] find a few dummy PDFs ( e.g. other urbanism theses). They have to have different layouts (e.g. single vs multicolumn; images, text boxes, etc.)
[ ] select a few pages per document
[ ] create a unit test for convert_pdf_text function,
[ ] the expected outcome should be a snippet of text from the selected pages

alwil commented 1 year ago

@cforgaci , we've discussed with Selin this would be a nice task for her to help her get introduced to the project, code base and our data (i.e. the PDFs).
I hope it works well for you.

If so, could you grant Selin access to the Surfdrive folder raw_data?

alwil commented 1 year ago

@Selkubi you can test both on EMU thesis (a training dataset so to speak) and other bodies of texts ( e.g. other theses retrieved from the education repository