typesense / typesense-docsearch-scraper

A fork of Algolia's awesome DocSearch Scraper, customized to index data in Typesense (an open source alternative to Algolia)
https://typesense.org/docs/guide/docsearch.html
Other
97 stars 36 forks source link

requests.exceptions.InvalidURL when trying to crawl locally #10

Closed lanegoolsby closed 2 years ago

lanegoolsby commented 2 years ago

The string concatenation logic that builds the URL requires the TYPESENSE_PATH variable. That is not in the documentation.

If the variable is not present then the URL gets concatenated to http://host.docker.internal:8108None/collections/xyz

The 'None' part of the string is coming from here I think.

jasonbosco commented 2 years ago

@lanegoolsby Looks like this was a regression from #9. I've pushed out a fix. Could you do docker pull typesense/docsearch-scraper and try again?

lanegoolsby commented 2 years ago

Looks good!