Web Crawler based on a virtual ant colony optimization with green threads - Githubissues

Caidac-3301 / ThoughtPool

0 stars 1 forks source link

Web Crawler based on a virtual ant colony optimization with green threads #4

Open farkaskid opened 6 years ago

farkaskid commented 6 years ago

Prototype https://github.com/farkaskid/WebCrawler

farkaskid commented 6 years ago

Prototype goals.

[x] Ability to bound within a given domain.
[x] Control the memory usage by implementing a task queue.
[ ] Add a persistence layer either using a custom solution or Neo4j.

mahesh1996 commented 6 years ago

https://github.com/farkaskid/WebCrawler/pull/10 Bound within a given domain