spyglass-search / spyglass

A personal search engine: Create a searchable library from your personal documents, interests, and more!
https://docs.spyglass.fyi
GNU Affero General Public License v3.0
2.58k stars 59 forks source link

Support for crawling programming/library documentation #276

Open mainrs opened 1 year ago

mainrs commented 1 year ago

There are programs like Dash or Zeal that support downloading so-called doclets. The programs can then be used to search documentation offline.

Maybe a lense can be written to crawl these doclets in general.

a5huynh commented 1 year ago

Hey @mainrs , thanks for the request!

Are you using Dash/Zeal right now? And if so, which doclets are you most interested in?

mainrs commented 1 year ago

I do use Zeal right now. And I mostly use Java, Rust, CSS, HTML, Go doclets. Here is a list of everything that is supported:

https://kapeli.com/dash#docsets

The cool thing is, the doclets already crawl pages like Maven, RubyGems and co. and create documentation pages for every possible library. So integrating this would add a lot of content to spyglass.

klauss194 commented 1 year ago

I'd love to avtually be able to have some documentations offline