Add a codebase/repository WebCrawler and build an crawled documentation index in SCP

Cantara / SourceCodePortal

Organizational SourceCode Dashboard Portal

Apache License 2.0

6 stars 3 forks source link

Add a codebase/repository WebCrawler and build an crawled documentation index in SCP #4

Open totto opened 5 years ago

totto commented 5 years ago

The idea is to find and crawl blogs and presentations and other sources and add them to the SCP documentation index for a repo/group/organization - all info/documentation/++ in one place, always updated and close to the source

sherriff commented 5 years ago

Typically a web crawler which crawls the web after pages containing e.g. the github repository name?

totto commented 5 years ago

We currently crawl document-files on github and document links in poms... we'll work towards indexing and thus enable good search functionality and probably variants of hot/instant linking in scp at some point in time :)