Are we allowed to use selenium or scrapy instead of request to send requests to the URL link and then use beautifulsoup to parse over it? I have changed several topics and tried different websites that I want to crawl. Unfortunately, none of them returns the text I need.
Hello,
Are we allowed to use
selenium
orscrapy
instead ofrequest
to send requests to the URL link and then usebeautifulsoup
to parse over it? I have changed several topics and tried different websites that I want to crawl. Unfortunately, none of them returns the text I need.Thanks for the assistance in advance!