-
From Mark:
> The next things that need to happen for the warc-metadata-sidecar is to write a parser that will create cdxj files from the meta.gz files that an be merged with cdxj files that are gener…
-
```
root@npld-heritrix3-worker-1:/home/heritrix# curl "http://webrender:8010/render?url=https://fullfact.org/health/&warc_prefix=TEST-TMP"
Error: Protocol error (Target.activateTarget): Session cl…
-
This relates to www.mind.org.uk captures: https://www.webarchive.org.uk/act/wayback/archive/*/http://www.mind.org.uk/
- 502 example: https://www.webarchive.org.uk/act/wayback/archive/20220720112219…
-
`mvn install` fails with `"java.lang.NoClassDefFoundError: Could not initialize class org.archive.util.CLibrary" on Apple Silicon`.
To fix I upgraded the dependency in commons/pom.xml from:
```
…
-
I'm not sure what is causing this, or what the issue is. I've configured php settings to a T, and have installed and verified all of the recommended modules and versions. This is an installation fro…
-
Hi,
I have some warc files created using [warcit](https://github.com/webrecorder/warcit). Somehow after indexing (without errors or warnings), I can't find any page included in it on SolrWayback. I…
-
I am getting a build failure on RHEL 7.9 and Ubuntu 18.04 that looks to be introduced with the upgrade of maven-assembly-plugin (#414) regarding the group id being too big.
```
[INFO] Building ta…
-
When I try to crawl https pages over a proxy with Heritrix 3, I get following exceptions:
`java.io.IOException: RIS already open for ToeThread #5: https://www.XXX/robots.txt
at org.archive.io.Rec…
WI-IT updated
2 years ago
-
We've set up WCT and set the operator contact URL in the profile, however this data does not seem to propagate to the heritrix job configuration. I've attached four screenshots. Any idea what the prob…
-
For an in company use of webarchives, I'm experimenting transforming older Heritrix crawls to wacz (thanks to py-wacz). One of these transforms results in 48GB and reports 325.000 pages. Using this …