-
### Is your feature request related to a problem? Please describe.
Even though Joomla `5.2` has some new settings to eliminate duplicate pages, there are still https://github.com/joomla/joomla-cms/iss…
-
### Describe the bug
Bedrock crawling behavior is inconsistent with Java Editon, because a Bedrock player can in certain cases, sprint-crawl. This is an issue because it can trigger anticheats falsel…
-
### Is your feature request related to a problem? Please describe
When active and crawling BM opened thousands of outgoing UDP connections triggering ISP limit and making internet access for other …
-
-
Adding sitemap.xml and robots.txt files helps optimize a website for search engines.
Sitemap.xml provides a list of important URLs, helping search engines discover, crawl, and index new and updated…
-
Adding sitemap.xml and robots.txt files helps optimize a website for search engines.
Sitemap.xml provides a list of important URLs, helping search engines discover, crawl, and index new and updated…
-
Shutters are now blocked by tables when they close. This is most likely due to the recent addition of crawling, which changed how table collision works in regard to bullets. This mean's that some mapp…
-
-
I've just tested the latest main branch functionality on Windows 11 or Ubuntu and encountered an issue. Here’s the test code I used:
```
python
async def main():
async with AsyncWebCrawler(
…
-
Adding sitemap.xml and robots.txt files helps optimize a website for search engines.
Sitemap.xml provides a list of important URLs, helping search engines discover, crawl, and index new and updated…