webrecorder / pywb

Core Python Web Archiving Toolkit for replay and recording of web archives
https://pypi.python.org/pypi/pywb
GNU General Public License v3.0
1.34k stars 207 forks source link

replay stopped while auto indexing #827

Open oskarhek opened 1 year ago

oskarhek commented 1 year ago

Describe the bug

when warcs are indexed, replay is not possible until indexing is done. even if it concerns an other collection.

Steps to reproduce the bug

replay an already indexed website. create a new collections ant put some warcs in it when indexing try to start replay the previous indexed website again

Expected behavior

indexed website is shown

Environment

docker image running locally default uwsgi is used.

Additional context

startup log pywb:

[uWSGI] getting INI configuration from /uwsgi/uwsgi.ini 2023-03-23T09:31:26.016290000Z Starting uWSGI 2.0.21 (64bit) on [Thu Mar 23 09:31:25 2023] 2023-03-23T09:31:26.017455000Z compiled with version: 10.2.1 20210110 on 03 February 2023 01:43:53 2023-03-23T09:31:26.017611000Z os: Linux-5.15.82-0-virt #1-Alpine SMP Mon, 12 Dec 2022 09:15:17 +0000 2023-03-23T09:31:26.017991000Z nodename: e155314011e4 2023-03-23T09:31:26.018240000Z machine: x86_64 2023-03-23T09:31:26.018424000Z clock source: unix 2023-03-23T09:31:26.018797000Z pcre jit disabled 2023-03-23T09:31:26.019595000Z detected number of CPU cores: 10 2023-03-23T09:31:26.019996000Z current working directory: /webarchive 2023-03-23T09:31:26.020517000Z detected binary path: /usr/local/bin/uwsgi 2023-03-23T09:31:26.020856000Z uWSGI running as root, you can use --uid/--gid/--chroot options 2023-03-23T09:31:26.020997000Z WARNING: you are running uWSGI as root !!! (use the --uid flag) 2023-03-23T09:31:26.021241000Z your memory page size is 4096 bytes 2023-03-23T09:31:26.021437000Z detected max file descriptor number: 1048576 2023-03-23T09:31:26.026752000Z - async cores set to 100 - fd table size: 1048576 2023-03-23T09:31:26.027983000Z lock engine: pthread robust mutexes 2023-03-23T09:31:26.029059000Z thunder lock: disabled (you can enable it with --thunder-lock) 2023-03-23T09:31:26.030045000Z uwsgi socket 0 bound to TCP address :8080 fd 3 2023-03-23T09:31:26.032251000Z uwsgi socket 1 bound to TCP address :8081 fd 4 2023-03-23T09:31:26.039844000Z uWSGI running as root, you can use --uid/--gid/--chroot options 2023-03-23T09:31:26.039969000Z WARNING: you are running uWSGI as root !!! (use the --uid flag) 2023-03-23T09:31:26.040167000Z Python version: 3.8.16 (default, Jan 24 2023, 00:12:41) [GCC 10.2.1 20210110] 2023-03-23T09:31:26.096210000Z Python main interpreter initialized at 0x55b420979a10 2023-03-23T09:31:26.096569000Z uWSGI running as root, you can use --uid/--gid/--chroot options 2023-03-23T09:31:26.096873000Z WARNING: you are running uWSGI as root !!! (use the --uid flag) 2023-03-23T09:31:26.097335000Z python threads support enabled 2023-03-23T09:31:26.097538000Z your server socket listen backlog is limited to 100 connections 2023-03-23T09:31:26.097904000Z your mercy for graceful operations on workers is 60 seconds 2023-03-23T09:31:26.098141000Z mapped 14503928 bytes (14163 KB) for 100 cores 2023-03-23T09:31:26.099333000Z Operational MODE: async 2023-03-23T09:31:29.853894000Z WSGI app 0 (mountpoint='') ready in 3 seconds on interpreter 0x55b420979a10 pid: 1 (default app) 2023-03-23T09:31:29.854479000Z uWSGI running as root, you can use --uid/--gid/--chroot options 2023-03-23T09:31:29.854900000Z WARNING: you are running uWSGI as root !!! (use the --uid flag) 2023-03-23T09:31:29.855261000Z uWSGI is running in multiple interpreter mode 2023-03-23T09:31:29.855478000Z spawned uWSGI master process (pid: 1) 2023-03-23T09:31:29.860003000Z spawned uWSGI worker 1 (pid: 16, cores: 100) 2023-03-23T09:31:29.863134000Z running gevent loop engine [addr:0x55b41f99f5f0]