jina-ai / reader

Convert any URL to an LLM-friendly input with a simple prefix https://r.jina.ai/
https://jina.ai/reader
Apache License 2.0
6.51k stars 504 forks source link

Jina Search with subdomains #91

Closed PriNova closed 2 months ago

PriNova commented 2 months ago

When I try to search for a specific topic on a subdomain it won't work as expected.

For example, I searched for the usage of geometry nodes in the Blender documentation at docs.blender.com, but the results are from the entire web.

For that I used the newly introduced site headers argument.

It would be nice to have the ability search under subdomains too.

nomagick commented 2 months ago

Hi. Previously there was an issue with the site parameter. Now you can do it by adding ?site=example.com query parameters.

Fixed in 786b1828b7dff4c702081b8cd0305c1e632065b1

PriNova commented 2 months ago

Hi. Previously there was an issue with the site parameter. Now you can do it by adding ?site=example.com query parameters.

Fixed in 786b182

Thank you for the hint. My initial question is, does this work also with subdomain URLs like docs.blender.org as the site: header with the API?

nomagick commented 2 months ago

My observation is yes. We are using Brave Search API, you can try for yourself on https://search.brave.com/. Specifying site: after the search term.

PriNova commented 2 months ago

It works as expected @nomagick Thank you for your effort and explanation.