search

indrajithi / tiny-web-crawler

A simple and easy to use web crawler for Python
MIT License
55 stars 11 forks source link

Use one or more `Options` classes #46

Closed Mews closed 1 week ago

Mews commented 1 week ago

Instead of having every option for the Spider class be a separate argument, there should be one or more Options classes that store these options and then get passed to the Spider class.

Once this is addressed, the max-attributes option in .pylintrc should be set back to 15

indrajithi commented 1 week ago

Yes. Agree. I had the same thought.