Glutexo / onigumo

Parallel web scraping framework

MIT License

3 stars 1 forks source link

📝 Readme suggestions #96

Open Glutexo opened 2 years ago

Glutexo commented 2 years ago

I received some feedback on the README:

[ ] Promote the Spider/Application section to the top. The fact that Onigumo is a framework and not a ready-to-use solution is essential information. (Agreed.)
[ ] Calling applications “Spiders” is unintuitive. Either explain it right at the top and use punctuation to emphasize it is a custom term, or ditch it entirely and revert to “application” instead.

Glutexo commented 2 years ago

Thoughts, @nappex?

nappex commented 2 years ago

First bullet absolutely agree. Second bullet, I agree with unintuitive opinion but if we rewrite spider to application then will be confused with web application. At least I have a problem to separate themm to each other. That is not necessary wrong it can be just my misunderstanding these ideas.. My understanding is web app is something what we want to crawl and spider app is something what is saying how should be web app crawled...

Glutexo commented 2 years ago

That’s a good point! It may be good to explain briefly but visibly what the term “spider” means and that it avoids confusion with a web application.

Glutexo commented 2 years ago

113 clarifies the job of the Operator.