search

fastrepl / canary

Canary provides "Ask AI" for any developer-facing product. Open-source and self-hostable. 🐤🐦🐧
https://docs.getcanary.dev
MIT License
3 stars 0 forks source link

Configurable URL filtering for website source #7

Open yujonglee opened 1 week ago

yujonglee commented 1 week ago

https://github.com/fastrepl/canary/blob/62346f2a89b915f4e62c1b8decfcee2e51c7e5d7/core/lib/canary/sources/source.ex#L6-L15

For example, https://svelte-5-preview.vercel.app/docs/introduction is start_url, but should not be base_url. https://svelte-5-preview.vercel.app/doc is invalid url for start_url, but good base_url.

yujonglee commented 5 days ago

Not very important after c9a4a42894c22985e8ac5450dcba911ebfdb6d44.