issues
search
internetarchive
/
warcprox
WARC writing MITM HTTP/S proxy
378
stars
54
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
New --blackout-period option to skip writing redundant revisits to WARC
#99
vbanos
closed
6 years ago
7
WIP: trough dedup bug fix
#98
nlevitt
closed
6 years ago
0
run trough with python 3.6 plus travis cleanup
#97
nlevitt
closed
6 years ago
0
WIP: fix travis-ci build
#96
nlevitt
closed
6 years ago
1
Copy edits
#95
kblumenthal
closed
6 years ago
2
Expose statistics using Prometheus's conventions
#94
anjackson
opened
6 years ago
1
docs
#93
nlevitt
closed
6 years ago
0
New --black-out-period option to skip writing redundant revisits to WARC
#92
vbanos
closed
6 years ago
4
Max request duration option
#91
vbanos
closed
6 years ago
2
Require dedup-bucket in Warcprox-Meta to perform dedup
#90
vbanos
closed
6 years ago
2
Max request duration limit
#89
vbanos
closed
6 years ago
7
Dedup only urls with Warcprox-Meta and warc-prefix
#88
vbanos
closed
6 years ago
5
ProxyingRecorder block_digest optimisation
#87
vbanos
closed
6 years ago
6
Configurable min dedupable size for text/binary resources
#86
vbanos
closed
6 years ago
2
WIP do not merge: make test proxy single-threaded so tests will pass
#85
nlevitt
closed
6 years ago
1
make test server multithreaded so tests will pass
#84
nlevitt
closed
6 years ago
1
do not merge, debugging: trace everything happening in test http server
#83
nlevitt
closed
6 years ago
0
do not merge: Still weird
#82
nlevitt
closed
6 years ago
0
CDX dedup improvements
#81
vbanos
closed
6 years ago
0
(do not merge) some more logging to try to get to the bottom
#80
nlevitt
closed
6 years ago
0
Skip CDX dedup check for captures with empty payload
#79
vbanos
closed
6 years ago
0
Increase proxy_client socket send buffer and use TCP_NODELAY
#78
vbanos
closed
6 years ago
0
CDX Dedup improvements
#77
vbanos
closed
6 years ago
0
Fix ListenerPostfetchProcessor typo
#76
vbanos
closed
6 years ago
0
Configurable SpooledTemporaryFile max memory size
#75
vbanos
closed
6 years ago
0
a minimal example of a warcprox plugin
#74
galgeek
closed
6 years ago
1
Improve incoming request handling by accepting all requests
#73
vbanos
closed
6 years ago
1
Remote server connection pooling
#72
vbanos
closed
6 years ago
2
Generate wildcard certs to reduce the number of certs generated
#71
vbanos
closed
6 years ago
2
Support client connections using HTTP/1.1
#70
vbanos
closed
6 years ago
3
Removed 3 Xes and made a more meaningful TODO note
#69
ibnesayeed
closed
6 years ago
1
add support for do_not_archive attribute and for plugin CHAIN_POSITION...
#68
galgeek
closed
6 years ago
2
Use updated list of SSL ciphers
#67
vbanos
closed
6 years ago
2
Add option to limit max resource size
#66
vbanos
closed
6 years ago
4
Disable retries and set timeout=2.0 for CDX Dedup server
#65
vbanos
closed
6 years ago
0
multi-threaded WARC writer architecture
#64
nlevitt
closed
6 years ago
0
Implement multi-threaded WARC writer architecture
#63
vbanos
closed
6 years ago
0
Remove redundant RLock from WarcWriterPool
#62
vbanos
closed
6 years ago
1
Make remote server connection timeout configurable
#61
vbanos
closed
6 years ago
3
Improve SSL context definition
#60
vbanos
closed
6 years ago
1
make plugin api more flexible
#59
nlevitt
closed
6 years ago
0
Parallelize CDX Server dedup queries
#58
vbanos
closed
6 years ago
0
Pass --certs-dir option to CertificateAuthority
#57
vbanos
closed
6 years ago
1
Remove redundant file flush() in writer
#56
vbanos
closed
6 years ago
0
Remove unused writer.tell() call in Writer.write_records
#55
vbanos
closed
6 years ago
1
Parallelize trough
#54
nlevitt
closed
6 years ago
0
Add --cdxserver-dedup-cookies option
#53
vbanos
closed
6 years ago
0
Use socket.TCP_NODELAY to improve performance
#52
vbanos
closed
6 years ago
0
WIP postfetch chain
#51
nlevitt
closed
6 years ago
0
Configurable CdxServerDedup urllib3 connection pool size
#50
vbanos
closed
6 years ago
0
Previous
Next