search

NielsRogge / Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.
MIT License
9.15k stars 1.42k forks source link

Handling Multiple Images PDFs in a Notebook and Seeking Guidance on Code Modification #431

Closed AnasLahmar closed 3 months ago

AnasLahmar commented 3 months ago

Hi @NielsRogge

I want to thank you for the work you've done in this notebook

Please, You mentioned in your code that this notebook can be used in case one wants to work with multiple images-PDFs.

Do you have a notebook on this subject?

Thank you in advance for your feedback.

NielsRogge commented 3 months ago

Hi,

Thanks for your interest in my notebook. Yes I already have a notebook which supports multiple-page PDFs, will upload it soon. See also my reply at #429

ML-Engineering-Parth commented 3 months ago

Hi, please can you upload this. I have a dire need for this. Thank you so much, amazing repo btw!

NielsRogge commented 3 months ago

Ok I've just uploaded it here: https://github.com/NielsRogge/Transformers-Tutorials/blob/master/Idefics2/Fine_tune_Idefics2_for_multi_page_PDF_question_answering_on_DUDE.ipynb

Note that memory requirements are pretty heavy (I used an A100 and had to limit the number of pages per PDF).

sarugh4 commented 3 months ago

Amazing!!!!!! Thank you!!!

AnasLahmar commented 3 months ago

Great work! Thank you, @NielsRogge.