-
### Is your feature request related to a problem? Please describe.
Not having the rel=noopener attribute applied to outgoing links is a potential security issue. So far, Joomla has tackled this by en…
-
The CSE Search list is very long, making it hard for me to tell which ones might work or I could be selecting known broken searches... Either way, I have tested this with 10 randomly selected searches…
-
# Motivation
The following sites are being transitioned from Drupal 7 to the U of I Libraries' archival system:
* iwp.uiowa.edu/publishing-gallery
* iwp.uiowa.edu/shse
* iwp.uiowa.edu/silkroutes
* rio…
-
Since modern browsers expect SSL all the time, there's no need to support intermingled http/https like we did in original Zen Cart back when SSL was only used by those who were security-minded.
Thu…
-
### Question
Can we have all language site URLs in the sitemap?
Our SEO agency recommends the following,
_We need an individual sitemap for each country. We need only one sitemap, with all the URLs…
-
# Environment
- most recent image (nginx 1.25.2) from 17 Oct
- using nginx:mainline-bookworm
# Bug
When building our image including ndk/lua/brotli with 1.25.2 as baseline, most of our XHR calls…
-
Instead of storing the whole URL in the spider's state in `Crawly.Middlewares.UniqueRequest`, I suggest hashing the URL and storing it instead.
I guess taking the first quarter of a sha256 would do…
-
In her COMP 360 project, which covers our work here, @katehausladen mentioned various smaller issues with the crawler. I am opening this issue as an omnibus issue stub. @katehausladen will take the le…
-
**Acceptance Criteria**
See "Add robots.txt and sitemap.txt routes to all sites" in the SEO TRD
https://docs.google.com/document/d/1HiokABLO__GErYr3zjWVsVo7S4_qVR6pGg_i_ut3eu4/edit#heading=h.qp0ns3j…
-
Goal: ability to selectively combine effects of
* "Discourage search engines from indexing this site"
* "Restrict site access to visitors who are logged in or allowed by IP address"
Expected `/…