search

medialab / hyphe

Websites crawler with built-in exploration and control web interface
http://hyphe.medialab.sciences-po.fr/demo/
GNU Affero General Public License v3.0
329 stars 59 forks source link

Pending for more URLS #497

Closed SeyedAlirezaMalih closed 6 months ago

SeyedAlirezaMalih commented 6 months ago

I am trying to import more than 25 URLS to crawl, but the page pending after 25 URLS.

Yomguithereal commented 6 months ago

Without more information, I am afraid I cannot help you. Are you running an instance locally? What do you mean by pending?

SeyedAlirezaMalih commented 6 months ago

Without more information, I am afraid I cannot help you. Are you running an instance locally? What do you mean by pending?

yes im trying to crawl more than 25 urls in my own server, but when try to insert more than 25 urls in /import urls or even tried to put a file which contains more than 25 urls in the import section, but the page trying to pending or loading, and never finished. I hope it would be clear :), tnx

SeyedAlirezaMalih commented 6 months ago

Without more information, I am afraid I cannot help you. Are you running an instance locally? What do you mean by pending?

yes im trying to crawl more than 25 urls in my own server, but when try to insert more than 25 urls in /import urls or even tried to put a file which contains more than 25 urls in the import section, but the page trying to pending or loading, and never finished. I hope it would be clear :), tnx

My fault Sorry, there are some issues for some websites which have entity ".site" :)