search

readthedocs / readthedocs.org

The source code that powers readthedocs.org
https://readthedocs.org/
MIT License
8.03k stars 3.58k forks source link

Unable to start local rtd #9681

Closed FranzForstmayr closed 1 year ago

FranzForstmayr commented 2 years ago

Trying to start a local version for debugging according to this manual https://dev.readthedocs.io/en/latest/install.html failed.

I'm unable to open devthedocs.org

Here's the output from docker

inv docker.up
Starting community_storage_1  ... done
Recreating community_server_1  ... done
Starting community_database_1 ... done
Starting community_cache_1    ... done
Recreating community_celery_1  ... done
Recreating community_web_1     ... done
Recreating community_proxito_1 ... done
Recreating community_build_1   ... done
Recreating community_nginx_1   ... done
Recreating community_search_1  ... done
Attaching to community_database_1, community_storage_1, community_cache_1, community_server_1, community_proxito_1, community_celery_1, community_web_1, community_build_1, community_search_1
cache_1     | 1:C 19 Oct 2022 20:45:49.923 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
cache_1     | 1:C 19 Oct 2022 20:45:49.923 # Redis version=6.0.5, bits=64, commit=00000000, modified=0, pid=1, just started
cache_1     | 1:C 19 Oct 2022 20:45:49.923 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf
cache_1     | 1:M 19 Oct 2022 20:45:49.924 * Running mode=standalone, port=6379.
cache_1     | 1:M 19 Oct 2022 20:45:49.924 # Server initialized
cache_1     | 1:M 19 Oct 2022 20:45:49.925 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
celery_1    | Executing common.sh
celery_1    | wait-for-it.sh: waiting 180 seconds for search:9200
build_1     | Executing common.sh
build_1     | Running Docker with reload
cache_1     | 1:M 19 Oct 2022 20:45:49.925 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this issue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarted after THP is disabled.
database_1  | 
database_1  | PostgreSQL Database directory appears to contain a database; Skipping initialization
database_1  | 
cache_1     | 1:M 19 Oct 2022 20:45:49.925 * Loading RDB produced by version 6.0.5
cache_1     | 1:M 19 Oct 2022 20:45:49.925 * RDB age 1870 seconds
cache_1     | 1:M 19 Oct 2022 20:45:49.925 * RDB memory usage when created 0.78 Mb
database_1  | 2022-10-19 20:45:49.793 UTC [1] LOG:  starting PostgreSQL 12.5 (Debian 12.5-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit
proxito_1   | Executing common.sh
proxito_1   | Running Docker with reload
database_1  | 2022-10-19 20:45:49.794 UTC [1] LOG:  listening on IPv4 address "0.0.0.0", port 5432
database_1  | 2022-10-19 20:45:49.794 UTC [1] LOG:  listening on IPv6 address "::", port 5432
cache_1     | 1:M 19 Oct 2022 20:45:49.925 * DB loaded from disk: 0.000 seconds
cache_1     | 1:M 19 Oct 2022 20:45:49.925 * Ready to accept connections
database_1  | 2022-10-19 20:45:49.795 UTC [1] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
database_1  | 2022-10-19 20:45:49.803 UTC [26] LOG:  database system was shut down at 2022-10-19 20:14:39 UTC
web_1       | wait-for-it.sh: waiting 60 seconds for database:5432
web_1       | wait-for-it.sh: database:5432 is available after 0 seconds
web_1       | Executing common.sh
web_1       | Running Docker with reload
storage_1   | API: http://10.10.0.2:9000  http://127.0.0.1:9000 
storage_1   | 
storage_1   | Console: http://10.10.0.2:9009 http://127.0.0.1:9009 
storage_1   | 
storage_1   | Documentation: https://docs.min.io
database_1  | 2022-10-19 20:45:49.808 UTC [1] LOG:  database system is ready to accept connections
community_server_1 exited with code 0
storage_1   | 
storage_1   |  You are running an older version of MinIO released 7 months ago 
storage_1   |  Update: 
storage_1   | Run `mc admin update` 
storage_1   | 
storage_1   | 
build_1     | [nodemon] 2.0.20
build_1     | [nodemon] reading config /usr/src/app/checkouts/nodemon.json
build_1     | [nodemon] to restart at any time, enter `rs`
build_1     | [nodemon] or send SIGUSR2 to 9 to restart
build_1     | [nodemon] ignoring: .tox/**/* .direnv/**/* user_builds/**/* */management/commands**/* *migrations/**/* *test**/* *.pyc *.pyo
build_1     | [nodemon] watching path(s): readthedocs/**/* readthedocsinc
build_1     | [nodemon] watching extensions: py
build_1     | [nodemon] starting `python3 -m celery -A readthedocs.worker worker -Ofair -c 1 -Q builder,celery,default,build01,build:default,build:large -l INFO --statedb=/var/run/celery/worker.state`
build_1     | [nodemon] spawning
build_1     | [nodemon] child pid: 22
web_1       | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
proxito_1   | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
build_1     | [nodemon] watching 1766 files
web_1       | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
proxito_1   | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
build_1     | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
build_1     | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
proxito_1   | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
web_1       | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
web_1       | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
proxito_1   | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
build_1     | /usr/local/lib/python3.10/dist-packages/celery/platforms.py:840: SecurityWarning: You're running the worker with superuser privileges: this is
build_1     | absolutely not recommended!
build_1     | 
build_1     | Please specify a different user using the --uid option.
build_1     | 
build_1     | User information: uid=0 euid=0 gid=0 egid=0
build_1     | 
build_1     |   warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
build_1     |  
build_1     |  -------------- celery@83b4002d688e v5.2.7 (dawn-chorus)
build_1     | --- ***** ----- 
build_1     | -- ******* ---- Linux-5.15.0-52-generic-x86_64-with-glibc2.35 2022-10-19 20:45:52
build_1     | - *** --- * --- 
build_1     | - ** ---------- [config]
build_1     | - ** ---------- .> app:         readthedocs:0x7f9773192e30
build_1     | - ** ---------- .> transport:   redis://cache:6379/0
build_1     | - ** ---------- .> results:     redis://cache:6379/0
build_1     | - *** --- * --- .> concurrency: 1 (prefork)
build_1     | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
build_1     | --- ***** ----- 
build_1     |  -------------- [queues]
build_1     |                 .> build01          exchange=build01(direct) key=build01
build_1     |                 .> build:default    exchange=build:default(direct) key=build:default
build_1     |                 .> build:large      exchange=build:large(direct) key=build:large
build_1     |                 .> builder          exchange=builder(direct) key=builder
build_1     |                 .> celery           exchange=celery(direct) key=celery
build_1     |                 .> default          exchange=default(direct) key=default
build_1     | 
build_1     | [tasks]
build_1     |   . readthedocs.analytics.tasks.analytics_event
build_1     |   . readthedocs.analytics.tasks.analytics_pageview
build_1     |   . readthedocs.analytics.tasks.delete_old_page_counts
build_1     |   . readthedocs.audit.tasks.delete_old_personal_audit_logs
build_1     |   . readthedocs.builds.tasks.archive_builds_task
build_1     |   . readthedocs.builds.tasks.delete_closed_external_versions
build_1     |   . readthedocs.builds.tasks.send_build_notifications
build_1     |   . readthedocs.builds.tasks.send_build_status
build_1     |   . readthedocs.builds.tasks.sync_versions_task
build_1     |   . readthedocs.core.tasks.clear_persistent_messages
build_1     |   . readthedocs.core.tasks.send_email_task
build_1     |   . readthedocs.domains.tasks.email_pending_custom_domains
build_1     |   . readthedocs.oauth.tasks.attach_webhook
build_1     |   . readthedocs.oauth.tasks.sync_active_users_remote_repositories
build_1     |   . readthedocs.oauth.tasks.sync_remote_repositories
build_1     |   . readthedocs.oauth.tasks.sync_remote_repositories_organizations
build_1     |   . readthedocs.organizations.tasks.mark_organization_assets_not_cleaned
build_1     |   . readthedocs.projects.tasks.builds.sync_repository_task
build_1     |   . readthedocs.projects.tasks.builds.update_docs_task
build_1     |   . readthedocs.projects.tasks.search.fileify
build_1     |   . readthedocs.projects.tasks.search.remove_search_indexes
build_1     |   . readthedocs.projects.tasks.utils.finish_inactive_builds
build_1     |   . readthedocs.projects.tasks.utils.remove_build_storage_paths
build_1     |   . readthedocs.search.tasks.create_new_es_index
build_1     |   . readthedocs.search.tasks.delete_objects_in_es
build_1     |   . readthedocs.search.tasks.delete_old_search_queries_from_db
build_1     |   . readthedocs.search.tasks.index_missing_objects
build_1     |   . readthedocs.search.tasks.index_objects_to_es
build_1     |   . readthedocs.search.tasks.record_search_query
build_1     |   . readthedocs.search.tasks.switch_es_index
build_1     |   . readthedocs.subscriptions.tasks.daily_email
build_1     |   . readthedocs.subscriptions.tasks.disable_organization_expired_trials
build_1     |   . readthedocs.subscriptions.tasks.weekly_subscription_stats_email
build_1     |   . readthedocs.telemetry.tasks.delete_old_build_data
build_1     |   . readthedocs.telemetry.tasks.save_build_data
build_1     | 
build_1     | [info     ] Connected to redis://cache:6379/0 [celery.worker.consumer.connection] 
build_1     | [info     ] mingle: searching for neighbors [celery.worker.consumer.mingle] 
proxito_1   | Watching for file changes with StatReloader
proxito_1   | [info     ] Watching for file changes with StatReloader [django.utils.autoreload] 
proxito_1   | Performing system checks...
proxito_1   | 
web_1       | Watching for file changes with StatReloader
web_1       | [info     ] Watching for file changes with StatReloader [django.utils.autoreload] 
web_1       | Performing system checks...
web_1       | 
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:53,138Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "version[7.14.0], pid[7], build[default/docker/dd5a0a2acaa2045ff9624f3729fc8a6f40835aa1/2021-07-29T20:49:32.864135063Z], OS[Linux/5.15.0-52-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/16.0.1/16.0.1+9]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:53,140Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:53,140Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, --add-opens=java.base/java.io=ALL-UNNAMED, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-8095272344648969459, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms128m, -Xmx128m, -XX:MaxDirectMemorySize=67108864, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" }
proxito_1   | System check identified no issues (1 silenced).
web_1       | System check identified no issues (1 silenced).
proxito_1   | October 19, 2022 - 20:45:53
proxito_1   | Django version 3.2.16, using settings 'readthedocs.settings.proxito_docker'
proxito_1   | Starting development server at http://0.0.0.0:8000/
proxito_1   | Quit the server with CONTROL-C.
web_1       | October 19, 2022 - 20:45:53
web_1       | Django version 3.2.16, using settings 'readthedocs.settings.web_docker'
web_1       | Starting development server at http://0.0.0.0:8000/
web_1       | Quit the server with CONTROL-C.
build_1     | [info     ] mingle: all alone              [celery.worker.consumer.mingle] 
build_1     | [warning  ] /usr/local/lib/python3.10/dist-packages/celery/fixups/django.py:203: UserWarning: Using settings.DEBUG leads to a memory
build_1     |             leak, never use this setting in production environments!
build_1     |   warnings.warn('''Using settings.DEBUG leads to a memory
build_1     |  [py.warnings] 
build_1     | [info     ] celery@83b4002d688e ready.     [celery.apps.worker] 
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [aggs-matrix-stats]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [analysis-common]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [constant-keyword]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [frozen-indices]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [ingest-common]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,527Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [ingest-geoip]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [ingest-user-agent]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [kibana]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [lang-expression]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [lang-mustache]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [lang-painless]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [mapper-extras]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [mapper-version]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [parent-join]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,528Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [percolator]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [rank-eval]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [reindex]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [repositories-metering-api]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [repository-encrypted]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [repository-url]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [runtime-fields-common]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [search-business-rules]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [searchable-snapshots]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,529Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [snapshot-repo-test-kit]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [spatial]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [transform]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [transport-netty4]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [unsigned-long]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [vectors]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [wildcard]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-aggregate-metric]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-analytics]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-async]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-async-search]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,530Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-autoscaling]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-ccr]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-core]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-data-streams]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-deprecation]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-enrich]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-eql]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-fleet]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-graph]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-identity-provider]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-ilm]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,531Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-logstash]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-ml]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-monitoring]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-ql]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-rollup]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-security]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-shutdown]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-sql]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-stack]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-text-structure]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-voting-only-node]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,532Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "loaded module [x-pack-watcher]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,533Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "docker-cluster", "node.name": "search", "message": "no plugins loaded" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,551Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "search", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/nvme0n1p1)]], net usable_space [765.8gb], net total_space [915.8gb], types [ext4]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,551Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "docker-cluster", "node.name": "search", "message": "heap size [128mb], compressed ordinary object pointers [true]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:54,593Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "node name [search], node ID [g1ee6CTvTnCOYCy3TguxPQ], cluster name [docker-cluster], roles [transform, data_frozen, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:57,045Z", "level": "INFO", "component": "o.e.x.m.p.l.CppLogMessageHandler", "cluster.name": "docker-cluster", "node.name": "search", "message": "[controller/216] [Main.cc@117] controller (64 bit): Version 7.14.0 (Build 45f9e3d7ff96e7) Copyright (c) 2021 Elasticsearch BV" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:57,328Z", "level": "INFO", "component": "o.e.x.s.a.s.FileRolesStore", "cluster.name": "docker-cluster", "node.name": "search", "message": "parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:57,888Z", "level": "INFO", "component": "o.e.i.g.LocalDatabases", "cluster.name": "docker-cluster", "node.name": "search", "message": "initialized default databases [[GeoLite2-Country.mmdb, GeoLite2-City.mmdb, GeoLite2-ASN.mmdb]], config databases [[]] and watching [/usr/share/elasticsearch/config/ingest-geoip] for changes" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:57,889Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "initialized database registry, using geoip-databases directory [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,237Z", "level": "INFO", "component": "o.e.t.NettyAllocator", "cluster.name": "docker-cluster", "node.name": "search", "message": "creating NettyAllocator with the following configs: [name=unpooled, suggested_max_allocation_size=1mb, factors={es.unsafe.use_unpooled_allocator=null, g1gc_enabled=true, g1gc_region_size=4mb, heap_size=128mb}]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,285Z", "level": "INFO", "component": "o.e.d.DiscoveryModule", "cluster.name": "docker-cluster", "node.name": "search", "message": "using discovery type [single-node] and seed hosts providers [settings]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,578Z", "level": "INFO", "component": "o.e.g.DanglingIndicesState", "cluster.name": "docker-cluster", "node.name": "search", "message": "gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,864Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "initialized" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,864Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "starting ..." }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,871Z", "level": "INFO", "component": "o.e.x.s.c.f.PersistentCache", "cluster.name": "docker-cluster", "node.name": "search", "message": "persistent cache index loaded" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:58,946Z", "level": "INFO", "component": "o.e.t.TransportService", "cluster.name": "docker-cluster", "node.name": "search", "message": "publish_address {10.10.0.8:9300}, bound_addresses {0.0.0.0:9300}" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,139Z", "level": "WARN", "component": "o.e.b.BootstrapChecks", "cluster.name": "docker-cluster", "node.name": "search", "message": "max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,140Z", "level": "INFO", "component": "o.e.c.c.Coordinator", "cluster.name": "docker-cluster", "node.name": "search", "message": "cluster UUID [kv6VBnmGR7KWXYB4esUcMw]" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,263Z", "level": "INFO", "component": "o.e.c.s.MasterService", "cluster.name": "docker-cluster", "node.name": "search", "message": "elected-as-master ([1] nodes joined)[{search}{g1ee6CTvTnCOYCy3TguxPQ}{wYRzZU5xQamLqD0jKVcanA}{10.10.0.8}{10.10.0.8:9300}{cdfhilmrstw} elect leader, _BECOME_MASTER_TASK_, _FINISH_ELECTION_], term: 5, version: 77, delta: master node changed {previous [], current [{search}{g1ee6CTvTnCOYCy3TguxPQ}{wYRzZU5xQamLqD0jKVcanA}{10.10.0.8}{10.10.0.8:9300}{cdfhilmrstw}]}" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,315Z", "level": "INFO", "component": "o.e.c.s.ClusterApplierService", "cluster.name": "docker-cluster", "node.name": "search", "message": "master node changed {previous [], current [{search}{g1ee6CTvTnCOYCy3TguxPQ}{wYRzZU5xQamLqD0jKVcanA}{10.10.0.8}{10.10.0.8:9300}{cdfhilmrstw}]}, term: 5, version: 77, reason: Publication{term=5, version=77}" }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,347Z", "level": "INFO", "component": "o.e.h.AbstractHttpServerTransport", "cluster.name": "docker-cluster", "node.name": "search", "message": "publish_address {10.10.0.8:9200}, bound_addresses {0.0.0.0:9200}", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,348Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "docker-cluster", "node.name": "search", "message": "started", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | wait-for-it.sh: search:9200 is available after 9 seconds
celery_1    | Running Docker with reload
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,535Z", "level": "INFO", "component": "o.e.l.LicenseService", "cluster.name": "docker-cluster", "node.name": "search", "message": "license [93074f40-18d8-46ba-ab58-0031850cc72b] mode [basic] - valid", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,536Z", "level": "INFO", "component": "o.e.x.s.s.SecurityStatusChangeListener", "cluster.name": "docker-cluster", "node.name": "search", "message": "Active license is now [BASIC]; Security is disabled", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,537Z", "level": "WARN", "component": "o.e.x.s.s.SecurityStatusChangeListener", "cluster.name": "docker-cluster", "node.name": "search", "message": "Elasticsearch built-in security features are not enabled. Without authentication, your cluster could be accessible to anyone. See https://www.elastic.co/guide/en/elasticsearch/reference/7.14/security-minimal-setup.html to enable security.", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "deprecation.elasticsearch", "timestamp": "2022-10-19T20:45:59,537Z", "level": "DEPRECATION", "component": "o.e.d.x.s.s.SecurityStatusChangeListener", "cluster.name": "docker-cluster", "node.name": "search", "message": "The default behavior of disabling security on basic licenses is deprecated. In a later version of Elasticsearch, the value of [xpack.security.enabled] will default to \"true\" , regardless of the license level. See https://www.elastic.co/guide/en/elasticsearch/reference/7.14/security-minimal-setup.html to enable security, or explicitly disable security by setting [xpack.security.enabled] to false in elasticsearch.yml", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,541Z", "level": "INFO", "component": "o.e.g.GatewayService", "cluster.name": "docker-cluster", "node.name": "search", "message": "recovered [2] indices into cluster_state", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | [nodemon] 2.0.20
celery_1    | [nodemon] reading config /usr/src/app/checkouts/nodemon.json
celery_1    | [nodemon] to restart at any time, enter `rs`
celery_1    | [nodemon] or send SIGUSR2 to 38 to restart
celery_1    | [nodemon] ignoring: .tox/**/* .direnv/**/* user_builds/**/* */management/commands**/* *migrations/**/* *test**/* *.pyc *.pyo
celery_1    | [nodemon] watching path(s): readthedocs/**/* readthedocsinc
celery_1    | [nodemon] watching extensions: py
celery_1    | [nodemon] starting `python3 -m celery -A readthedocs.worker worker -Ofair -c 2 -Q web,web01,reindex,autoscaling -l INFO`
celery_1    | [nodemon] spawning
celery_1    | [nodemon] child pid: 51
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,776Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "search", "message": "updating geoip databases", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,776Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "search", "message": "fetching geoip databases overview from [https://geoip.elastic.co/v1/database?elastic_geoip_service_tos=agree]", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,824Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "downloading geoip database [GeoLite2-Country.mmdb] to [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-Country.mmdb.tmp.gz]", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,825Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "downloading geoip database [GeoLite2-ASN.mmdb] to [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-ASN.mmdb.tmp.gz]", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,825Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "downloading geoip database [GeoLite2-City.mmdb] to [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-City.mmdb.tmp.gz]", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:45:59,846Z", "level": "INFO", "component": "o.e.c.r.a.AllocationService", "cluster.name": "docker-cluster", "node.name": "search", "message": "Cluster health status changed from [RED] to [YELLOW] (reason: [shards started [[project_index][0]]]).", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | [nodemon] watching 1766 files
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,278Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "database file changed [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-ASN.mmdb], reload database...", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,291Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "database file changed [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-Country.mmdb], reload database...", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | [debug    ] Using slumber v2.              [readthedocs.api.v2.client] api_host=http://web:8000 username=admin
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,484Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "search", "message": "geoip database [GeoLite2-ASN.mmdb] is up to date, updated timestamp", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,530Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "search", "message": "geoip database [GeoLite2-City.mmdb] is up to date, updated timestamp", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,560Z", "level": "INFO", "component": "o.e.i.g.GeoIpDownloader", "cluster.name": "docker-cluster", "node.name": "search", "message": "geoip database [GeoLite2-Country.mmdb] is up to date, updated timestamp", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,829Z", "level": "INFO", "component": "o.e.i.g.DatabaseRegistry", "cluster.name": "docker-cluster", "node.name": "search", "message": "database file changed [/tmp/elasticsearch-8095272344648969459/geoip-databases/g1ee6CTvTnCOYCy3TguxPQ/GeoLite2-City.mmdb], reload database...", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | [info     ] Metrics tasks could not be imported. [readthedocs.core.apps] 
search_1    | {"type": "server", "timestamp": "2022-10-19T20:46:00,879Z", "level": "INFO", "component": "o.e.m.j.JvmGcMonitorService", "cluster.name": "docker-cluster", "node.name": "search", "message": "[gc][2] overhead, spent [255ms] collecting in the last [1s]", "cluster.uuid": "kv6VBnmGR7KWXYB4esUcMw", "node.id": "g1ee6CTvTnCOYCy3TguxPQ"  }
celery_1    | /usr/local/lib/python3.10/dist-packages/celery/platforms.py:840: SecurityWarning: You're running the worker with superuser privileges: this is
celery_1    | absolutely not recommended!
celery_1    | 
celery_1    | Please specify a different user using the --uid option.
celery_1    | 
celery_1    | User information: uid=0 euid=0 gid=0 egid=0
celery_1    | 
celery_1    |   warnings.warn(SecurityWarning(ROOT_DISCOURAGED.format(
celery_1    |  
celery_1    |  -------------- celery@3df9d78facb3 v5.2.7 (dawn-chorus)
celery_1    | --- ***** ----- 
celery_1    | -- ******* ---- Linux-5.15.0-52-generic-x86_64-with-glibc2.35 2022-10-19 20:46:01
celery_1    | - *** --- * --- 
celery_1    | - ** ---------- [config]
celery_1    | - ** ---------- .> app:         readthedocs:0x7f7de4dbae60
celery_1    | - ** ---------- .> transport:   redis://cache:6379/0
celery_1    | - ** ---------- .> results:     redis://cache:6379/0
celery_1    | - *** --- * --- .> concurrency: 2 (prefork)
celery_1    | -- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
celery_1    | --- ***** ----- 
celery_1    |  -------------- [queues]
celery_1    |                 .> autoscaling      exchange=autoscaling(direct) key=autoscaling
celery_1    |                 .> reindex          exchange=reindex(direct) key=reindex
celery_1    |                 .> web              exchange=web(direct) key=web
celery_1    |                 .> web01            exchange=web01(direct) key=web01
celery_1    | 
celery_1    | [tasks]
celery_1    |   . readthedocs.analytics.tasks.analytics_event
celery_1    |   . readthedocs.analytics.tasks.analytics_pageview
celery_1    |   . readthedocs.analytics.tasks.delete_old_page_counts
celery_1    |   . readthedocs.audit.tasks.delete_old_personal_audit_logs
celery_1    |   . readthedocs.builds.tasks.archive_builds_task
celery_1    |   . readthedocs.builds.tasks.delete_closed_external_versions
celery_1    |   . readthedocs.builds.tasks.send_build_notifications
celery_1    |   . readthedocs.builds.tasks.send_build_status
celery_1    |   . readthedocs.builds.tasks.sync_versions_task
celery_1    |   . readthedocs.core.tasks.clear_persistent_messages
celery_1    |   . readthedocs.core.tasks.send_email_task
celery_1    |   . readthedocs.domains.tasks.email_pending_custom_domains
celery_1    |   . readthedocs.oauth.tasks.attach_webhook
celery_1    |   . readthedocs.oauth.tasks.sync_active_users_remote_repositories
celery_1    |   . readthedocs.oauth.tasks.sync_remote_repositories
celery_1    |   . readthedocs.oauth.tasks.sync_remote_repositories_organizations
celery_1    |   . readthedocs.organizations.tasks.mark_organization_assets_not_cleaned
celery_1    |   . readthedocs.projects.tasks.builds.sync_repository_task
celery_1    |   . readthedocs.projects.tasks.builds.update_docs_task
celery_1    |   . readthedocs.projects.tasks.search.fileify
celery_1    |   . readthedocs.projects.tasks.search.remove_search_indexes
celery_1    |   . readthedocs.projects.tasks.utils.finish_inactive_builds
celery_1    |   . readthedocs.projects.tasks.utils.remove_build_storage_paths
celery_1    |   . readthedocs.search.tasks.create_new_es_index
celery_1    |   . readthedocs.search.tasks.delete_objects_in_es
celery_1    |   . readthedocs.search.tasks.delete_old_search_queries_from_db
celery_1    |   . readthedocs.search.tasks.index_missing_objects
celery_1    |   . readthedocs.search.tasks.index_objects_to_es
celery_1    |   . readthedocs.search.tasks.record_search_query
celery_1    |   . readthedocs.search.tasks.switch_es_index
celery_1    |   . readthedocs.subscriptions.tasks.daily_email
celery_1    |   . readthedocs.subscriptions.tasks.disable_organization_expired_trials
celery_1    |   . readthedocs.subscriptions.tasks.weekly_subscription_stats_email
celery_1    |   . readthedocs.telemetry.tasks.delete_old_build_data
celery_1    |   . readthedocs.telemetry.tasks.save_build_data
celery_1    | 
celery_1    | [info     ] Connected to redis://cache:6379/0 [celery.worker.consumer.connection] 
celery_1    | [info     ] mingle: searching for neighbors [celery.worker.consumer.mingle] 
build_1     | [info     ] sync with celery@3df9d78facb3  [celery.worker.control] 
celery_1    | [info     ] mingle: sync with 1 nodes      [celery.worker.consumer.mingle] 
celery_1    | [info     ] mingle: sync complete          [celery.worker.consumer.mingle] 
celery_1    | [warning  ] /usr/local/lib/python3.10/dist-packages/celery/fixups/django.py:203: UserWarning: Using settings.DEBUG leads to a memory
celery_1    |             leak, never use this setting in production environments!
celery_1    |   warnings.warn('''Using settings.DEBUG leads to a memory
celery_1    |  [py.warnings] 
celery_1    | [info     ] celery@3df9d78facb3 ready.     [celery.apps.worker]
humitos commented 2 years ago

I don't see any error in the output that you shared. What's the error that you receive when accessing http://devthedocs.org ?

FranzForstmayr commented 2 years ago

From Chrome: DNS_PROBE_FINISHED_NXDOMAIN

agjohnson commented 1 year ago

This looks like maybe a local DNS issue. What does the domain resolve to?

Locally for me:

% dig devthedocs.org

; <<>> DiG 9.18.8 <<>> devthedocs.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 52293
;; flags: qr rd ra; QUERY: 1, ANSWER: 1, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 512
;; QUESTION SECTION:
;devthedocs.org.            IN  A

;; ANSWER SECTION:
devthedocs.org.     1799    IN  A   127.0.0.1

;; Query time: 49 msec
;; SERVER: 8.8.8.8#53(8.8.8.8) (UDP)
;; WHEN: Wed Dec 07 10:12:56 PST 2022
;; MSG SIZE  rcvd: 59
FranzForstmayr commented 1 year ago 
; <<>> DiG 9.18.1-1ubuntu1.2-Ubuntu <<>> devthedocs.org
;; global options: +cmd
;; Got answer:
;; ->>HEADER<<- opcode: QUERY, status: NOERROR, id: 58311
;; flags: qr rd ra; QUERY: 1, ANSWER: 0, AUTHORITY: 0, ADDITIONAL: 1

;; OPT PSEUDOSECTION:
; EDNS: version: 0, flags:; udp: 65494
;; QUESTION SECTION:
;devthedocs.org.            IN  A

;; Query time: 0 msec
;; SERVER: 127.0.0.53#53(127.0.0.53) (UDP)
;; WHEN: Thu Dec 08 22:54:27 CET 2022
;; MSG SIZE  rcvd: 43

Sorry, I'm no expert in this stuff.... You can close this issue if you like, my problem with readthedocs has been solved in the meantime (Without local build)

agjohnson commented 1 year ago

Oh good, glad you're maybe sorted out!

If you're still having trouble, try:

dig devthedocs.org +trace

This will show the full traversal on resolution. The most likely culprit is that this is a DNS trouble local to your network though.

FranzForstmayr commented 1 year ago 

; <<>> DiG 9.18.1-1ubuntu1.2-Ubuntu <<>> devthedocs.org +trace
;; global options: +cmd
.           52338   IN  NS  e.root-servers.net.
.           52338   IN  NS  d.root-servers.net.
.           52338   IN  NS  h.root-servers.net.
.           52338   IN  NS  c.root-servers.net.
.           52338   IN  NS  b.root-servers.net.
.           52338   IN  NS  j.root-servers.net.
.           52338   IN  NS  l.root-servers.net.
.           52338   IN  NS  g.root-servers.net.
.           52338   IN  NS  k.root-servers.net.
.           52338   IN  NS  m.root-servers.net.
.           52338   IN  NS  f.root-servers.net.
.           52338   IN  NS  i.root-servers.net.
.           52338   IN  NS  a.root-servers.net.
;; Received 239 bytes from 127.0.0.53#53(127.0.0.53) in 12 ms

org.            172800  IN  NS  d0.org.afilias-nst.org.
org.            172800  IN  NS  a0.org.afilias-nst.info.
org.            172800  IN  NS  c0.org.afilias-nst.info.
org.            172800  IN  NS  a2.org.afilias-nst.info.
org.            172800  IN  NS  b0.org.afilias-nst.org.
org.            172800  IN  NS  b2.org.afilias-nst.org.
org.            86400   IN  DS  26974 8 2 4FEDE294C53F438A158C41D39489CD78A86BEB0D8A0AEAFF14745C0D 16E1DE32
org.            86400   IN  RRSIG   DS 8 1 86400 20221225050000 20221212040000 18733 . SbD0KaJbXRCQbTqgyRpI/y2pUtitnb+BWyZnDXTZaE5KjYbldoBBlF5f MkoTGSckC5UTVLWXcTLg23qBPOKELVNPkN0kFckdF1cCFm6yaKfpcOqJ kBF2+CD8xNrHNi6BkMDyXRa+I7YQNipJwWt64Yyh9Y/88+vkdDjhBKRw yRpPlX+sU/B33YUZSNQhzMlOaA8RFrHycPGC9uBgpqSMeitzTcqahq4N iKfNAKqxQQtV6wbfi/P3/NZq/4cFkgwPv4YXdjiueH01qWLO8WbDRleX Lh0Cr1LiWGogbotaMNvSewSB3HIA8xe/zCoqzq8b6OQP3VWR3yRN8YyY zfpX3A==
;; Received 780 bytes from 2001:503:ba3e::2:30#53(a.root-servers.net) in 24 ms

devthedocs.org.     3600    IN  NS  dns1.registrar-servers.com.
devthedocs.org.     3600    IN  NS  dns2.registrar-servers.com.
gdtpongmpok61u9lvnipqor8lra9l4t0.org. 3600 IN NSEC3 1 1 0 332539EE7F95C32A GDTREA8KMJ2RNEQEN4M2OGJ26KFSUKJ7 NS SOA RRSIG DNSKEY NSEC3PARAM
gdtpongmpok61u9lvnipqor8lra9l4t0.org. 3600 IN RRSIG NSEC3 8 2 3600 20230102194222 20221212184222 37749 org. aO80TwEuXBIfFRtH7KWm7z/5Y7zwBTyfmAr90F7vxYiMDx7NN8Rize5Q Em3ZQLO543Ci8/RNOP2PT31pZc2TLaTnLuL/G21yeRQc5g0xQz566hM0 fdi+oIivQr9pewO553XfotXFpWiBUViHkwuWQpmGGN6tS1XKgT3Q6T4P JVs=
r22eha42fnub01e5891jt0ppmfp55abn.org. 3600 IN NSEC3 1 1 0 332539EE7F95C32A R22IG63IR7RDTU6A9JT00LUOD3QD8M4S NS DS RRSIG
r22eha42fnub01e5891jt0ppmfp55abn.org. 3600 IN RRSIG NSEC3 8 2 3600 20221230152222 20221209142222 37749 org. jy4tkpskXTTDlmjisiWikdcIqAdz2gBwAqxpGjSKy5pKCm10Ls5OcFCQ vJniP6Tp4mqb8rLHGfNjV8JHR+VKq6IrP+emTwQe/+bTsCt0Lm1EZyLd p36CebvCH6GQtsDbbP2scpnBuBI4QIsbT7iiGLkLGmorCRT/oEOp9Mbd R1I=
;; Received 603 bytes from 2001:500:b::1#53(c0.org.afilias-nst.info) in 108 ms

devthedocs.org.     1799    IN  A   127.0.0.1
devthedocs.org.     1800    IN  NS  dns1.registrar-servers.com.
devthedocs.org.     1800    IN  NS  dns2.registrar-servers.com.
;; Received 118 bytes from 2610:a1:1025::200#53(dns2.registrar-servers.com) in 24 ms
agjohnson commented 1 year ago

Yeah, so something seems wrong with your local resolution -- your network, ISP, etc. You do get the correct result querying up to the root nameservers (devthedocs.org. 1799 IN A 127.0.0.1).

So, not something wrong with RTD or our DNS it seems, and I don't have any easy suggestions here (DNS is hard, as is local networking). But hopefully this gives some direction for where to look to solve your issue.

I suppose this can be closed, but if you find something that indicates our records are off for some reason, let's reopen this.