-
### How are you running AnythingLLM?
Docker (local)
### What happened?
Subdomains seem to be only supported for normal TLDs.
Something like `https://confluence.myorg.at/display/SPACE/*` works.
So…
-
## Description
Reported by rollbar. 18 times between 2024-04-13 and 2024-08-19 on productions server.
https://app.rollbar.com/a/gfsc/fix/item/placecal-production/417
Doesn't seem like a big …
-
Follows on from discussions in #63 - currently the `HostAlias` setting is relatively limited, requiring an exact match before it crawls a link with that domain.
To make crawling a large number of s…
-
hykuup knapsack tenant covenant.hykuup.com, has communicated that the load times for their site are long. Please investigate.
-
This is my idea page: https://pooriajr.com/ideas
Here's a gif showing how it doesn't work
![CleanShot 2024-02-26 at 19 50 53](https://github.com/lindylearn/aboutideasnow/assets/14811629/ebf693e5-71f…
-
Name of Crawler: ???
Settings:
- url: www.spiegel.de
- blacklist:
- sport
- dienste
- extra
- netzwelt
- karriere
- reise
- stil
- international
- follow subdomai…
-
For example, I was thinking of using this library to crawl a single site for pages.
This library looks great by the way - much higher quality than any of the other existing crawler libraries I've i…
-
Hello,
Over the past few months I've been working on an improved version of the [reconness-universal-wrapper](https://github.com/hiddengearz/reconness-universal-wrapper) I made a few months ago and…
-
we need to crawl many Internet sites and encountered an issue with `www` prefix:
some sites redirect to their domains without `www`, some other way round.
Unfortunately, such case cannot be handle b…
-
## Is your feature request related to a problem? Please describe.
When using the crawler, there is an input that allows for the use of discovery patterns. However, this appears to be limited to add…