Glutexo / onigumo

Parallel web scraping framework
MIT License
3 stars 1 forks source link

Define a Minimum Viable Product #207

Open Glutexo opened 9 months ago

Glutexo commented 9 months ago

We have a Minimal Viable Product GitHub Project. Use it to define, what such a minimal product should look like: what features are essential, but also what does not need to be there.

A „viable“ product should contain the main three components: an operator, a downloader, and a parser and a very simple complete Spider with an operator, a parser and a materializer. In that state, Onigumo should be able to do its work from the start to the end, utilizing a userspace code.

It is not required for the MVP to work as a supervised, multi-threaded application. The app does not have provide a stable, user-friendly interface. Using a custom Spider can be done by editing the source code.

It would be nice to have documentation transtlated into English, but it is not necessary for the minimul product to be „viable“.