issues
search
LangStream
/
langstream
LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka.
https://langstream.ai
Apache License 2.0
379
stars
28
forks
source link
[webcrawler] Handle bad sitemaps and allow to skip them
#679
Closed
eolivelli
closed
8 months ago
eolivelli
commented
8 months ago
Fixes #678
Summary:
handle errors while parsing sitemaps
allow to skip sitemaps with "forbidden paths"
Fixes #678
Summary: