How to see progress of Indexing

stanford-futuredata / ColBERT

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

MIT License

2.68k stars 355 forks source link

How to see progress of Indexing #278

Closed meti-94 closed 5 months ago

meti-94 commented 6 months ago

I am currently using ColBERTv2 to create an information retrieval (IR) system for millions of facts presented in the form of sentences. The testing phase has worked well so far, but since I am facing limitations in resources, it is essential for me to monitor the progress of indexing. I was wondering if there is any way to track the progression, for instance, by elapsed or remaining time, or any other means available?

okhat commented 5 months ago

It currently prints out this information to the console. Is that visible on your end?

meti-94 commented 5 months ago

I was able to observe the progress by adjusting the settings of my IPython notebook kernel. Thank you for providing such an excellent solution!