search

overhangio / tutor

The Docker-based Open edX distribution designed for peace of mind
https://docs.tutor.overhang.io/
GNU Affero General Public License v3.0
927 stars 444 forks source link

Missing python dependency #320

Closed menardorama closed 4 years ago

menardorama commented 4 years ago

In latest tutor release lms and cms job are failing because of missing django dependencies

Once manually installed in the cms and lms pod makemigrations and migrate are running fine.

This prevent tutor k8s init to complete correctly

regisb commented 4 years ago

I find this quite surprising. Can you please paste here the command that you are running as well as the logs from the corresponding containers?

menardorama commented 4 years ago

Sure, so running on minikube on OSX

 ✘ tmenard@MacBook-Pro-de-Thomas  ~  tutor k8s quickstart
==================================================
        Interactive platform configuration
==================================================
Your website domain name for students (LMS) [yourdomain.com] 
Your website domain name for teachers (CMS) [studio.yourdomain.com] 
Your platform name/title [My Open edX] 
Your public contact email address [contact@yourdomain.com] 
The default language code for the platform [fr] 
Activate SSL/TLS certificates for HTTPS access? Important note: this will NOT work in a development environment. [Y/n] n
Configuration saved to /Users/tmenard/Library/Application Support/tutor/config.yml
================================================
        Updating the current environment
================================================
Environment generated in /Users/tmenard/Library/Application Support/tutor/env
=====================================
        Starting the platform
=====================================
kubectl apply --kustomize /Users/tmenard/Library/Application Support/tutor/env --wait --selector app.kubernetes.io/component=namespace
namespace/openedx unchanged
kubectl apply --kustomize /Users/tmenard/Library/Application Support/tutor/env --wait --selector app.kubernetes.io/component=volume
persistentvolumeclaim/elasticsearch created
persistentvolumeclaim/mongodb created
persistentvolumeclaim/mysql created
persistentvolumeclaim/rabbitmq created
kubectl apply --kustomize /Users/tmenard/Library/Application Support/tutor/env --selector app.kubernetes.io/component notin (job, ingress, issuer)
namespace/openedx unchanged
configmap/mysql-config-hhmc458cc4 created
configmap/nginx-config-9g2gmfffb8 created
configmap/openedx-config-m84kg6dffh created
configmap/openedx-settings-cms-kb59b44h2b created
configmap/openedx-settings-lms-tt4m24gctb created
service/cms created
service/elasticsearch created
service/forum created
service/lms created
service/memcached created
service/mongodb created
service/mysql created
service/nginx created
service/rabbitmq created
service/smtp created
deployment.apps/cms-worker created
deployment.apps/cms created
deployment.apps/elasticsearch created
deployment.apps/forum created
deployment.apps/lms-worker created
deployment.apps/lms created
deployment.apps/memcached created
deployment.apps/mongodb created
deployment.apps/mysql created
deployment.apps/nginx created
deployment.apps/rabbitmq created
deployment.apps/smtp created
persistentvolumeclaim/elasticsearch unchanged
persistentvolumeclaim/mongodb unchanged
persistentvolumeclaim/mysql unchanged
persistentvolumeclaim/rabbitmq unchanged
================================================
        Database creation and migrations
================================================
Waiting for a mysql pod to be ready...
kubectl wait --namespace openedx --selector=app.kubernetes.io/instance=openedx-U95Hs2J8UKdhDSetXXiyBWcL,app.kubernetes.io/name=mysql --for=condition=ContainersReady --timeout=600s pod
pod/mysql-6f57d6bd47-72pnc condition met
Waiting for a elasticsearch pod to be ready...
kubectl wait --namespace openedx --selector=app.kubernetes.io/instance=openedx-U95Hs2J8UKdhDSetXXiyBWcL,app.kubernetes.io/name=elasticsearch --for=condition=ContainersReady --timeout=600s pod
pod/elasticsearch-746685b7c5-bn4t9 condition met
Waiting for a mongodb pod to be ready...
kubectl wait --namespace openedx --selector=app.kubernetes.io/instance=openedx-U95Hs2J8UKdhDSetXXiyBWcL,app.kubernetes.io/name=mongodb --for=condition=ContainersReady --timeout=600s pod
pod/mongodb-6b9599cdbf-ngxl7 condition met
Initialising all services...
kubectl apply --kustomize /Users/tmenard/Library/Application Support/tutor/env --selector app.kubernetes.io/name=mysql-job-20200504193121
job.batch/mysql-job-20200504193121 created
Job mysql-job-20200504193121 is running. To view the logs from this job, run:

    kubectl logs --namespace=openedx --follow $(kubectl get --namespace=openedx pods --selector=job-name=mysql-job-20200504193121 -o=jsonpath="{.items[0].metadata.name}")

Waiting for job completion...
Job mysql-job-20200504193121 successful.
Initialising lms...
kubectl apply --kustomize /Users/tmenard/Library/Application Support/tutor/env --selector app.kubernetes.io/name=lms-job-20200504193148
job.batch/lms-job-20200504193148 created
Job lms-job-20200504193148 is running. To view the logs from this job, run:

    kubectl logs --namespace=openedx --follow $(kubectl get --namespace=openedx pods --selector=job-name=lms-job-20200504193148 -o=jsonpath="{.items[0].metadata.name}")

Waiting for job completion...
Error: Job lms-job-20200504193148 failed. View the job logs to debug this issue.
 ✘ tmenard@MacBook-Pro-de-Thomas  ~  k get pods
NAME                             READY   STATUS             RESTARTS   AGE
cms-679b74b496-c86jn             1/1     Running            0          3m46s
cms-worker-84f5ddc66c-q9b5k      1/1     Running            1          3m46s
elasticsearch-746685b7c5-bn4t9   1/1     Running            0          3m45s
forum-5c48647f4c-c54w9           0/1     CrashLoopBackOff   4          3m45s
lms-566df9fbfd-cxj9t             1/1     Running            1          3m45s
lms-job-20200504193148-c4vkl     0/1     Error              0          2m59s
lms-job-20200504193148-p74rf     0/1     Error              0          2m37s
lms-worker-59989b584b-z7kw4      1/1     Running            1          3m45s
memcached-5dfb8b9d46-n8rfz       1/1     Running            0          3m45s
mongodb-6b9599cdbf-ngxl7         1/1     Running            0          3m45s
mysql-6f57d6bd47-72pnc           1/1     Running            0          3m45s
mysql-job-20200504193121-qvpkn   0/1     Completed          0          3m24s
nginx-84b8d4df47-8wklk           1/1     Running            0          3m45s
rabbitmq-5565ffb69-4nsf9         1/1     Running            0          3m45s
smtp-86bc5cd97d-6xlg9            1/1     Running            0          3m44s
 tmenard@MacBook-Pro-de-Thomas  ~  k exec -ti lms-566df9fbfd-cxj9t  bash
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# ./manage.py lms migrate
WARNING:py.warnings:/openedx/edx-platform/lms/djangoapps/courseware/__init__.py:5: DeprecationWarning: Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported
  warnings.warn("Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported", DeprecationWarning)

Traceback (most recent call last):
  File "./manage.py", line 120, in <module>
    startup.run()
  File "/openedx/edx-platform/lms/startup.py", line 19, in run
    django.setup()
  File "/openedx/venv/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/openedx/venv/local/lib/python2.7/site-packages/django/apps/registry.py", line 85, in populate
    app_config = AppConfig.create(entry)
  File "/openedx/venv/local/lib/python2.7/site-packages/django/apps/config.py", line 94, in create
    module = import_module(entry)
  File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
ImportError: No module named debug_toolbar
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# pip
pip     pip2    pip2.7  
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# pip
pip     pip2    pip2.7  
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# pip install debug_toolbar
Collecting debug_toolbar
  Could not find a version that satisfies the requirement debug_toolbar (from versions: )
No matching distribution found for debug_toolbar
You are using pip version 9.0.3, however version 20.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# pip install django-debug-toolbar
Collecting django-debug-toolbar
  Downloading https://files.pythonhosted.org/packages/01/9a/3db232bd15882d90d3c53de1f34ce0a522327849593c9198899713267cfe/django_debug_toolbar-1.11-py2.py3-none-any.whl (201kB)
    100% |################################| 204kB 2.7MB/s 
Requirement already satisfied: sqlparse>=0.2.0 in /openedx/venv/lib/python2.7/site-packages (from django-debug-toolbar)
Requirement already satisfied: Django>=1.11 in /openedx/venv/lib/python2.7/site-packages (from django-debug-toolbar)
Requirement already satisfied: pytz in /openedx/venv/lib/python2.7/site-packages (from Django>=1.11->django-debug-toolbar)
Installing collected packages: django-debug-toolbar
Successfully installed django-debug-toolbar-1.11
You are using pip version 9.0.3, however version 20.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# ./manage.py lms migrate
WARNING:py.warnings:/openedx/edx-platform/lms/djangoapps/courseware/__init__.py:5: DeprecationWarning: Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported
  warnings.warn("Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported", DeprecationWarning)

Traceback (most recent call last):
  File "./manage.py", line 120, in <module>
    startup.run()
  File "/openedx/edx-platform/lms/startup.py", line 19, in run
    django.setup()
  File "/openedx/venv/local/lib/python2.7/site-packages/django/__init__.py", line 27, in setup
    apps.populate(settings.INSTALLED_APPS)
  File "/openedx/venv/local/lib/python2.7/site-packages/django/apps/registry.py", line 85, in populate
    app_config = AppConfig.create(entry)
  File "/openedx/venv/local/lib/python2.7/site-packages/django/apps/config.py", line 94, in create
    module = import_module(entry)
  File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
ImportError: No module named debug_toolbar_mongo
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# pip install django-debug-toolbar-mongo
Collecting django-debug-toolbar-mongo
  Downloading https://files.pythonhosted.org/packages/12/82/24b7baf1af274b084978c740abedd8d2c2dcc451082c5c91596574345422/django-debug-toolbar-mongo-0.1.10.tar.gz
Building wheels for collected packages: django-debug-toolbar-mongo
  Running setup.py bdist_wheel for django-debug-toolbar-mongo ... done
  Stored in directory: /root/.cache/pip/wheels/73/a4/98/73ac40c6adf3c6155249ed9ecb086078dd197dc211ae021776
Successfully built django-debug-toolbar-mongo
Installing collected packages: django-debug-toolbar-mongo
Successfully installed django-debug-toolbar-mongo-0.1.10
You are using pip version 9.0.3, however version 20.1 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# ./manage.py lms migrate
WARNING:py.warnings:/openedx/edx-platform/lms/djangoapps/courseware/__init__.py:5: DeprecationWarning: Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported
  warnings.warn("Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported", DeprecationWarning)

2020-05-04 17:36:41,359 WARNING 285 [enterprise.utils] utils.py:50 - Could not import Registry from third_party_auth.provider
2020-05-04 17:36:41,359 WARNING 285 [enterprise.utils] utils.py:51 - cannot import name _LTI_BACKENDS
Operations to perform:
  Apply all migrations: admin, api_admin, assessment, auth, badges, block_structure, bookmarks, branding, bulk_email, catalog, celery_utils, certificates, commerce, completion, consent, content_type_gating, contentserver, contenttypes, cors_csrf, course_action_state, course_duration_limits, course_goals, course_groups, course_modes, course_overviews, courseware, crawlers, credentials, credit, dark_lang, database_fixups, degreed, django_comment_common, django_notify, django_openid_auth, djcelery, edx_oauth2_provider, edx_proctoring, edxval, email_marketing, embargo, enterprise, entitlements, experiments, external_auth, grades, instructor_task, integrated_channel, lms_xblock, microsite_configuration, milestones, mobile_api, notes, oauth2, oauth2_provider, oauth_dispatch, oauth_provider, organizations, programs, redirects, rss_proxy, sap_success_factors, schedules, self_paced, sessions, shoppingcart, site_configuration, sites, social_django, splash, static_replace, status, student, submissions, survey, teams, theming, third_party_auth, track, user_api, user_authn, util, verified_track_content, verify_student, video_config, video_pipeline, waffle, waffle_utils, wiki, workflow, xapi, xblock_django
Running migrations:
  Applying certificates.0003_data__default_modes... OK
  Applying certificates.0004_certificategenerationhistory... OK
  Applying certificates.0005_auto_20151208_0801... OK
  Applying certificates.0006_certificatetemplateasset_asset_slug... OK
  Applying certificates.0007_certificateinvalidation... OK
  Applying badges.0001_initial... OK
  Applying badges.0002_data__migrate_assertions... OK
  Applying badges.0003_schema__add_event_configuration... OK
  Applying block_structure.0001_config... OK
  Applying block_structure.0002_blockstructuremodel... OK
  Applying block_structure.0003_blockstructuremodel_storage... OK
  Applying block_structure.0004_blockstructuremodel_usagekeywithrun... OK
  Applying bookmarks.0001_initial... OK
  Applying branding.0001_initial... OK
  Applying course_modes.0001_initial... OK
  Applying course_modes.0002_coursemode_expiration_datetime_is_explicit... OK
  Applying course_modes.0003_auto_20151113_1443... OK
  Applying course_modes.0004_auto_20151113_1457... OK
  Applying course_modes.0005_auto_20151217_0958... OK
  Applying course_modes.0006_auto_20160208_1407... OK
  Applying course_modes.0007_coursemode_bulk_sku... OK
  Applying course_groups.0001_initial... OK
  Applying bulk_email.0001_initial... OK
  Applying bulk_email.0002_data__load_course_email_template...Installed 2 object(s) from 1 fixture(s)
 OK
  Applying bulk_email.0003_config_model_feature_flag... OK
  Applying bulk_email.0004_add_email_targets... OK
  Applying bulk_email.0005_move_target_data... OK
  Applying bulk_email.0006_course_mode_targets... OK
  Applying catalog.0001_initial... OK
  Applying catalog.0002_catalogintegration_username... OK
  Applying catalog.0003_catalogintegration_page_size... OK
  Applying catalog.0004_auto_20170616_0618... OK
  Applying catalog.0005_catalogintegration_long_term_cache_ttl... OK
  Applying djcelery.0001_initial... OK
  Applying celery_utils.0001_initial... OK
  Applying celery_utils.0002_chordable_django_backend... OK
  Applying certificates.0008_schema__remove_badges... OK
  Applying certificates.0009_certificategenerationcoursesetting_language_self_generation... OK
  Applying certificates.0010_certificatetemplate_language... OK
  Applying certificates.0011_certificatetemplate_alter_unique... OK
  Applying certificates.0012_certificategenerationcoursesetting_include_hours_of_effort... OK
  Applying certificates.0013_remove_certificategenerationcoursesetting_enabled... OK
  Applying certificates.0014_change_eligible_certs_manager... OK
  Applying commerce.0001_data__add_ecommerce_service_user...2020-05-04 17:36:48,971 INFO 285 [tracking] logger.py:42 - {"username": "", "event_source": "server", "name": "edx.user.settings.changed", "accept_language": "", "time": "2020-05-04T17:36:48.970922+00:00", "agent": "", "page": null, "host": "", "session": "", "referer": "", "context": {}, "ip": "", "event": {"user_id": 1, "truncated": [], "old": null, "setting": "password", "table": "auth_user", "new": null}, "event_type": "edx.user.settings.changed"}
 OK
  Applying commerce.0002_commerceconfiguration... OK
  Applying commerce.0003_auto_20160329_0709... OK
  Applying commerce.0004_auto_20160531_0950... OK
  Applying commerce.0005_commerceconfiguration_enable_automatic_refund_approval... OK
  Applying commerce.0006_auto_20170424_1734... OK
  Applying commerce.0007_auto_20180313_0609... OK
  Applying completion.0001_initial... OK
  Applying completion.0002_auto_20180125_1510... OK
  Applying enterprise.0001_initial... OK
  Applying enterprise.0002_enterprisecustomerbrandingconfiguration... OK
  Applying enterprise.0003_auto_20161104_0937... OK
  Applying enterprise.0004_auto_20161114_0434... OK
  Applying enterprise.0005_pendingenterprisecustomeruser... OK
  Applying enterprise.0006_auto_20161121_0241... OK
  Applying enterprise.0007_auto_20161109_1511... OK
  Applying enterprise.0008_auto_20161124_2355... OK
  Applying enterprise.0009_auto_20161130_1651... OK
  Applying enterprise.0010_auto_20161222_1212... OK
  Applying enterprise.0011_enterprisecustomerentitlement_historicalenterprisecustomerentitlement... OK
  Applying enterprise.0012_auto_20170125_1033... OK
  Applying enterprise.0013_auto_20170125_1157... OK
  Applying enterprise.0014_enrollmentnotificationemailtemplate_historicalenrollmentnotificationemailtemplate... OK
  Applying enterprise.0015_auto_20170130_0003... OK
  Applying enterprise.0016_auto_20170405_0647... OK
  Applying enterprise.0017_auto_20170508_1341... OK
  Applying enterprise.0018_auto_20170511_1357... OK
  Applying enterprise.0019_auto_20170606_1853... OK
  Applying enterprise.0020_auto_20170624_2316... OK
  Applying enterprise.0021_auto_20170711_0712... OK
  Applying enterprise.0022_auto_20170720_1543... OK
  Applying enterprise.0023_audit_data_reporting_flag... OK
  Applying enterprise.0024_enterprisecustomercatalog_historicalenterprisecustomercatalog... OK
  Applying enterprise.0025_auto_20170828_1412... OK
  Applying enterprise.0026_make_require_account_level_consent_nullable... OK
  Applying enterprise.0027_remove_account_level_consent... OK
  Applying enterprise.0028_link_enterprise_to_enrollment_template... OK
  Applying enterprise.0029_auto_20170925_1909... OK
  Applying enterprise.0030_auto_20171005_1600... OK
  Applying enterprise.0031_auto_20171012_1249... OK
  Applying enterprise.0032_reporting_model... OK
  Applying enterprise.0033_add_history_change_reason_field... OK
  Applying enterprise.0034_auto_20171023_0727... OK
  Applying enterprise.0035_auto_20171212_1129... OK
  Applying enterprise.0036_sftp_reporting_support... OK
  Applying enterprise.0037_auto_20180110_0450... OK
  Applying enterprise.0038_auto_20180122_1427... OK
  Applying enterprise.0039_auto_20180129_1034... OK
  Applying enterprise.0040_auto_20180129_1428... OK
  Applying enterprise.0041_auto_20180212_1507... OK
  Applying consent.0001_initial... OK
  Applying consent.0002_migrate_to_new_data_sharing_consent... OK
  Applying consent.0003_historicaldatasharingconsent_history_change_reason... OK
  Applying consent.0004_datasharingconsenttextoverrides... OK
  Applying sites.0002_alter_domain_unique... OK
  Applying course_overviews.0001_initial... OK
  Applying course_overviews.0002_add_course_catalog_fields... OK
  Applying course_overviews.0003_courseoverviewgeneratedhistory... OK
  Applying course_overviews.0004_courseoverview_org... OK
  Applying course_overviews.0005_delete_courseoverviewgeneratedhistory... OK
  Applying course_overviews.0006_courseoverviewimageset... OK
  Applying course_overviews.0007_courseoverviewimageconfig... OK
  Applying course_overviews.0008_remove_courseoverview_facebook_url... OK
  Applying course_overviews.0009_readd_facebook_url... OK
  Applying course_overviews.0010_auto_20160329_2317... OK
  Applying course_overviews.0011_courseoverview_marketing_url... OK
  Applying course_overviews.0012_courseoverview_eligible_for_financial_aid... OK
  Applying course_overviews.0013_courseoverview_language... OK
  Applying course_overviews.0014_courseoverview_certificate_available_date... OK
  Applying content_type_gating.0001_initial... OK
  Applying content_type_gating.0002_auto_20181119_0959... OK
  Applying content_type_gating.0003_auto_20181128_1407... OK
  Applying content_type_gating.0004_auto_20181128_1521... OK
  Applying contentserver.0001_initial... OK
  Applying contentserver.0002_cdnuseragentsconfig... OK
  Applying cors_csrf.0001_initial... OK
  Applying course_action_state.0001_initial... OK
  Applying course_duration_limits.0001_initial... OK
  Applying course_duration_limits.0002_auto_20181119_0959... OK
  Applying course_duration_limits.0003_auto_20181128_1407... OK
  Applying course_duration_limits.0004_auto_20181128_1521... OK
  Applying course_goals.0001_initial... OK
  Applying course_goals.0002_auto_20171010_1129... OK
  Applying course_groups.0002_change_inline_default_cohort_value... OK
  Applying course_groups.0003_auto_20170609_1455... OK
  Applying course_modes.0008_course_key_field_to_foreign_key... OK
  Applying course_modes.0009_suggested_prices_to_charfield... OK
  Applying course_modes.0010_archived_suggested_prices_to_charfield... OK
  Applying course_modes.0011_change_regex_for_comma_separated_ints... OK
  Applying courseware.0001_initial... OK
  Applying courseware.0002_coursedynamicupgradedeadlineconfiguration_dynamicupgradedeadlineconfiguration... OK
  Applying courseware.0003_auto_20170825_0935... OK
  Applying courseware.0004_auto_20171010_1639... OK
  Applying courseware.0005_orgdynamicupgradedeadlineconfiguration... OK
  Applying courseware.0006_remove_module_id_index... OK
  Applying courseware.0007_remove_done_index... OK
  Applying crawlers.0001_initial... OK
  Applying crawlers.0002_auto_20170419_0018... OK
  Applying credentials.0001_initial... OK
  Applying credentials.0002_auto_20160325_0631... OK
  Applying credentials.0003_auto_20170525_1109... OK
  Applying credentials.0004_notifycredentialsconfig... OK
  Applying credit.0001_initial... OK
  Applying credit.0002_creditconfig... OK
  Applying credit.0003_auto_20160511_2227... OK
  Applying credit.0004_delete_historical_credit_records... OK
  Applying dark_lang.0001_initial... OK
  Applying dark_lang.0002_data__enable_on_install... OK
  Applying database_fixups.0001_initial... OK
  Applying degreed.0001_initial... OK
  Applying degreed.0002_auto_20180104_0103... OK
  Applying degreed.0003_auto_20180109_0712... OK
  Applying degreed.0004_auto_20180306_1251... OK
  Applying degreed.0005_auto_20180807_1302... OK
  Applying degreed.0006_upgrade_django_simple_history... OK
  Applying django_comment_common.0001_initial... OK
  Applying django_comment_common.0002_forumsconfig... OK
  Applying django_comment_common.0003_enable_forums... OK
  Applying django_comment_common.0004_auto_20161117_1209... OK
  Applying django_comment_common.0005_coursediscussionsettings... OK
  Applying django_comment_common.0006_coursediscussionsettings_discussions_id_map... OK
  Applying django_comment_common.0007_discussionsidmapping... OK
  Applying django_comment_common.0008_role_user_index... OK
  Applying django_notify.0001_initial... OK
  Applying django_openid_auth.0001_initial... OK
  Applying oauth2.0001_initial... OK
  Applying edx_oauth2_provider.0001_initial... OK
  Applying edx_proctoring.0001_initial... OK
  Applying edx_proctoring.0002_proctoredexamstudentattempt_is_status_acknowledged... OK
  Applying edx_proctoring.0003_auto_20160101_0525... OK
  Applying edx_proctoring.0004_auto_20160201_0523... OK
  Applying edx_proctoring.0005_proctoredexam_hide_after_due... OK
  Applying edx_proctoring.0006_allowed_time_limit_mins... OK
  Applying edx_proctoring.0007_proctoredexam_backend... OK
  Applying edx_proctoring.0008_auto_20181116_1551... OK
  Applying edx_proctoring.0009_proctoredexamreviewpolicy_remove_rules... OK
  Applying edxval.0001_initial... OK
  Applying edxval.0002_data__default_profiles... OK
  Applying edxval.0003_coursevideo_is_hidden... OK
  Applying edxval.0004_data__add_hls_profile... OK
  Applying edxval.0005_videoimage... OK
  Applying edxval.0006_auto_20171009_0725... OK
  Applying edxval.0007_transcript_credentials_state... OK
  Applying edxval.0008_remove_subtitles... OK
  Applying edxval.0009_auto_20171127_0406... OK
  Applying edxval.0010_add_video_as_foreign_key... OK
  Applying edxval.0011_data__add_audio_mp3_profile... OK
  Applying email_marketing.0001_initial... OK
  Applying email_marketing.0002_auto_20160623_1656... OK
  Applying email_marketing.0003_auto_20160715_1145... OK
  Applying email_marketing.0004_emailmarketingconfiguration_welcome_email_send_delay... OK
  Applying email_marketing.0005_emailmarketingconfiguration_user_registration_cookie_timeout_delay... OK
  Applying email_marketing.0006_auto_20170711_0615... OK
  Applying email_marketing.0007_auto_20170809_0653... OK
  Applying email_marketing.0008_auto_20170809_0539... OK
  Applying email_marketing.0009_remove_emailmarketingconfiguration_sailthru_activation_template... OK
  Applying email_marketing.0010_auto_20180425_0800... OK
  Applying embargo.0001_initial... OK
  Applying embargo.0002_data__add_countries... OK
  Applying enterprise.0042_replace_sensitive_sso_username... OK
  Applying enterprise.0043_auto_20180507_0138... OK
  Applying enterprise.0044_reporting_config_multiple_types... OK
  Applying enterprise.0045_report_type_json... OK
  Applying enterprise.0046_remove_unique_constraints... OK
  Applying enterprise.0047_auto_20180517_0457... OK
  Applying enterprise.0048_enterprisecustomeruser_active... OK
  Applying enterprise.0049_auto_20180531_0321... OK
  Applying enterprise.0050_progress_v2... OK
  Applying enterprise.0051_add_enterprise_slug... OK
  Applying enterprise.0052_create_unique_slugs... OK
  Applying enterprise.0053_pendingenrollment_cohort_name... OK
  Applying enterprise.0053_auto_20180911_0811... OK
  Applying enterprise.0054_merge_20180914_1511... OK
  Applying enterprise.0055_auto_20181015_1112... OK
  Applying enterprise.0056_enterprisecustomerreportingconfiguration_pgp_encryption_key... OK
  Applying enterprise.0057_enterprisecustomerreportingconfiguration_enterprise_customer_catalogs... OK
  Applying enterprise.0058_auto_20181212_0145... OK
  Applying enterprise.0059_add_code_management_portal_config... OK
  Applying enterprise.0060_upgrade_django_simple_history... OK
  Applying student.0001_initial... OK
  Applying student.0002_auto_20151208_1034... OK
  Applying student.0003_auto_20160516_0938... OK
  Applying student.0004_auto_20160531_1422... OK
  Applying student.0005_auto_20160531_1653... OK
  Applying student.0006_logoutviewconfiguration... OK
  Applying student.0007_registrationcookieconfiguration... OK
  Applying student.0008_auto_20161117_1209... OK
  Applying student.0009_auto_20170111_0422... OK
  Applying student.0010_auto_20170207_0458... OK
  Applying student.0011_course_key_field_to_foreign_key... OK
  Applying student.0012_sociallink... OK
  Applying student.0013_delete_historical_enrollment_records... OK
  Applying entitlements.0001_initial... OK
  Applying entitlements.0002_auto_20171102_0719... OK
  Applying entitlements.0003_auto_20171205_1431... OK
  Applying entitlements.0004_auto_20171206_1729... OK
  Applying entitlements.0005_courseentitlementsupportdetail... OK
  Applying entitlements.0006_courseentitlementsupportdetail_action... OK
  Applying entitlements.0007_change_expiration_period_default... OK
  Applying entitlements.0008_auto_20180328_1107... OK
  Applying entitlements.0009_courseentitlement_refund_locked... OK
  Applying entitlements.0010_backfill_refund_lock... OK
  Applying experiments.0001_initial... OK
  Applying experiments.0002_auto_20170627_1402... OK
  Applying experiments.0003_auto_20170713_1148... OK
  Applying external_auth.0001_initial... OK
  Applying grades.0001_initial... OK
  Applying grades.0002_rename_last_edited_field... OK
  Applying grades.0003_coursepersistentgradesflag_persistentgradesenabledflag... OK
  Applying grades.0004_visibleblocks_course_id... OK
  Applying grades.0005_multiple_course_flags... OK
  Applying grades.0006_persistent_course_grades... OK
  Applying grades.0007_add_passed_timestamp_column... OK
  Applying grades.0008_persistentsubsectiongrade_first_attempted... OK
  Applying grades.0009_auto_20170111_1507... OK
  Applying grades.0010_auto_20170112_1156... OK
  Applying grades.0011_null_edited_time... OK
  Applying grades.0012_computegradessetting... OK
  Applying grades.0013_persistentsubsectiongradeoverride... OK
  Applying grades.0014_persistentsubsectiongradeoverridehistory... OK
  Applying instructor_task.0002_gradereportsetting... OK
  Applying waffle.0001_initial... OK
  Applying sap_success_factors.0001_initial... OK
  Applying sap_success_factors.0002_auto_20170224_1545... OK
  Applying sap_success_factors.0003_auto_20170317_1402... OK
  Applying sap_success_factors.0004_catalogtransmissionaudit_audit_summary... OK
  Applying sap_success_factors.0005_historicalsapsuccessfactorsenterprisecustomerconfiguration_history_change_reason... OK
  Applying sap_success_factors.0006_sapsuccessfactors_use_enterprise_enrollment_page_waffle_flag... OK
  Applying sap_success_factors.0007_remove_historicalsapsuccessfactorsenterprisecustomerconfiguration_history_change_reason... OK
  Applying sap_success_factors.0008_historicalsapsuccessfactorsenterprisecustomerconfiguration_history_change_reason... OK
  Applying sap_success_factors.0009_sapsuccessfactors_remove_enterprise_enrollment_page_waffle_flag... OK
  Applying sap_success_factors.0010_move_audit_tables_to_base_integrated_channel... OK
  Applying integrated_channel.0001_initial... OK
  Applying integrated_channel.0002_delete_enterpriseintegratedchannel... OK
  Applying integrated_channel.0003_catalogtransmissionaudit_learnerdatatransmissionaudit... OK
  Applying integrated_channel.0004_catalogtransmissionaudit_channel... OK
  Applying integrated_channel.0005_auto_20180306_1251... OK
  Applying integrated_channel.0006_delete_catalogtransmissionaudit... OK
  Applying lms_xblock.0001_initial... OK
  Applying microsite_configuration.0001_initial... OK
  Applying microsite_configuration.0002_auto_20160202_0228... OK
  Applying microsite_configuration.0003_delete_historical_records... OK
  Applying milestones.0001_initial... OK
  Applying milestones.0002_data__seed_relationship_types... OK
  Applying milestones.0003_coursecontentmilestone_requirements... OK
  Applying milestones.0004_auto_20151221_1445... OK
  Applying mobile_api.0001_initial... OK
  Applying mobile_api.0002_auto_20160406_0904... OK
  Applying mobile_api.0003_ignore_mobile_available_flag... OK
  Applying notes.0001_initial... OK
  Applying oauth2.0002_auto_20160404_0813... OK
  Applying oauth2.0003_client_logout_uri... OK
  Applying oauth2.0004_add_index_on_grant_expires... OK
  Applying oauth2.0005_grant_nonce... OK
  Applying organizations.0001_initial... OK
  Applying organizations.0002_auto_20170117_1434... OK
  Applying organizations.0003_auto_20170221_1138... OK
  Applying organizations.0004_auto_20170413_2315... OK
  Applying organizations.0005_auto_20171116_0640... OK
  Applying organizations.0006_auto_20171207_0259... OK
  Applying oauth2_provider.0001_initial... OK
  Applying oauth_dispatch.0001_initial... OK
  Applying oauth_dispatch.0002_scopedapplication_scopedapplicationorganization... OK
  Applying oauth_dispatch.0003_application_data... OK
  Applying oauth_dispatch.0004_auto_20180626_1349... OK
  Applying oauth_dispatch.0005_applicationaccess_type... OK
  Applying oauth_dispatch.0006_drop_application_id_constraints... OK
  Applying oauth2_provider.0002_08_updates... OK
  Applying oauth2_provider.0003_auto_20160316_1503... OK
  Applying oauth2_provider.0004_auto_20160525_1623... OK
  Applying oauth2_provider.0005_auto_20170514_1141... OK
  Applying oauth2_provider.0006_auto_20171214_2232... OK
  Applying oauth_dispatch.0007_restore_application_id_constraints... OK
  Applying oauth_provider.0001_initial... OK
  Applying programs.0001_initial... OK
  Applying programs.0002_programsapiconfig_cache_ttl... OK
  Applying programs.0003_auto_20151120_1613... OK
  Applying programs.0004_programsapiconfig_enable_certification... OK
  Applying programs.0005_programsapiconfig_max_retries... OK
  Applying programs.0006_programsapiconfig_xseries_ad_enabled... OK
  Applying programs.0007_programsapiconfig_program_listing_enabled... OK
  Applying programs.0008_programsapiconfig_program_details_enabled... OK
  Applying programs.0009_programsapiconfig_marketing_path... OK
  Applying programs.0010_auto_20170204_2332... OK
  Applying programs.0011_auto_20170301_1844... OK
  Applying programs.0012_auto_20170419_0018... OK
  Applying redirects.0001_initial... OK
  Applying rss_proxy.0001_initial... OK
  Applying sap_success_factors.0011_auto_20180104_0103... OK
  Applying sap_success_factors.0012_auto_20180109_0712... OK
  Applying sap_success_factors.0013_auto_20180306_1251... OK
  Applying sap_success_factors.0014_drop_historical_table... OK
  Applying sap_success_factors.0015_auto_20180510_1259... OK
  Applying sap_success_factors.0016_sapsuccessfactorsenterprisecustomerconfiguration_additional_locales... OK
  Applying sap_success_factors.0017_sapsuccessfactorsglobalconfiguration_search_student_api_path... OK
  Applying schedules.0001_initial... OK
  Applying schedules.0002_auto_20170816_1532... OK
  Applying schedules.0003_scheduleconfig... OK
  Applying schedules.0004_auto_20170922_1428... OK
  Applying schedules.0005_auto_20171010_1722... OK
  Applying schedules.0006_scheduleexperience... OK
  Applying schedules.0007_scheduleconfig_hold_back_ratio... OK
  Applying self_paced.0001_initial... OK
  Applying sessions.0001_initial... OK
  Applying shoppingcart.0001_initial... OK
  Applying shoppingcart.0002_auto_20151208_1034... OK
  Applying shoppingcart.0003_auto_20151217_0958... OK
  Applying shoppingcart.0004_change_meta_options... OK
  Applying site_configuration.0001_initial... OK
  Applying site_configuration.0002_auto_20160720_0231... OK
  Applying social_django.0001_initial... OK
  Applying social_django.0002_add_related_name... OK
  Applying social_django.0003_alter_email_max_length... OK
  Applying social_django.0004_auto_20160423_0400... OK
  Applying social_django.0005_auto_20160727_2333... OK
  Applying social_django.0006_partial... OK
  Applying social_django.0007_code_timestamp... OK
  Applying social_django.0008_partial_timestamp... OK
  Applying splash.0001_initial... OK
  Applying static_replace.0001_initial... OK
  Applying static_replace.0002_assetexcludedextensionsconfig... OK
  Applying status.0001_initial... OK
  Applying status.0002_update_help_text... OK
  Applying student.0014_courseenrollmentallowed_user... OK
  Applying student.0015_manualenrollmentaudit_add_role... OK
  Applying student.0016_coursenrollment_course_on_delete_do_nothing... OK
  Applying student.0017_accountrecovery... OK
  Applying student.0018_remove_password_history... OK
  Applying student.0019_auto_20181221_0540... OK
  Applying submissions.0001_initial... OK
  Applying submissions.0002_auto_20151119_0913... OK
  Applying submissions.0003_submission_status... OK
  Applying submissions.0004_remove_django_extensions... OK
  Applying survey.0001_initial... OK
  Applying teams.0001_initial... OK
  Applying theming.0001_initial... OK
  Applying third_party_auth.0001_initial... OK
  Applying third_party_auth.0002_schema__provider_icon_image... OK
  Applying third_party_auth.0003_samlproviderconfig_debug_mode... OK
  Applying third_party_auth.0004_add_visible_field... OK
  Applying third_party_auth.0005_add_site_field... OK
  Applying third_party_auth.0006_samlproviderconfig_automatic_refresh_enabled... OK
  Applying third_party_auth.0007_auto_20170406_0912... OK
  Applying third_party_auth.0008_auto_20170413_1455... OK
  Applying third_party_auth.0009_auto_20170415_1144... OK
  Applying third_party_auth.0010_add_skip_hinted_login_dialog_field... OK
  Applying third_party_auth.0011_auto_20170616_0112... OK
  Applying third_party_auth.0012_auto_20170626_1135... OK
  Applying third_party_auth.0013_sync_learner_profile_data... OK
  Applying third_party_auth.0014_auto_20171222_1233... OK
  Applying third_party_auth.0015_samlproviderconfig_archived... OK
  Applying third_party_auth.0016_auto_20180130_0938... OK
  Applying third_party_auth.0017_remove_icon_class_image_secondary_fields... OK
  Applying third_party_auth.0018_auto_20180327_1631... OK
  Applying third_party_auth.0019_consolidate_slug... OK
  Applying third_party_auth.0020_cleanup_slug_fields... OK
  Applying third_party_auth.0021_sso_id_verification... OK
  Applying third_party_auth.0022_auto_20181012_0307... OK
  Applying track.0001_initial... OK
  Applying user_api.0001_initial... OK
  Applying user_api.0002_retirementstate_userretirementstatus... OK
  Applying user_api.0003_userretirementrequest... OK
  Applying user_api.0004_userretirementpartnerreportingstatus... OK
  Applying user_authn.0001_data__add_login_service...2020-05-04 17:39:34,959 INFO 285 [tracking] logger.py:42 - {"username": "", "event_source": "server", "name": "edx.user.settings.changed", "accept_language": "", "time": "2020-05-04T17:39:34.958933+00:00", "agent": "", "page": null, "host": "", "session": "", "referer": "", "context": {}, "ip": "", "event": {"user_id": 2, "truncated": [], "old": null, "setting": "password", "table": "auth_user", "new": null}, "event_type": "edx.user.settings.changed"}
 OK
  Applying util.0001_initial... OK
  Applying util.0002_data__default_rate_limit_config... OK
  Applying verified_track_content.0001_initial... OK
  Applying verified_track_content.0002_verifiedtrackcohortedcourse_verified_cohort_name... OK
  Applying verified_track_content.0003_migrateverifiedtrackcohortssetting... OK
  Applying verify_student.0001_initial... OK
  Applying verify_student.0002_auto_20151124_1024... OK
  Applying verify_student.0003_auto_20151113_1443... OK
  Applying verify_student.0004_delete_historical_records... OK
  Applying verify_student.0005_remove_deprecated_models... OK
  Applying verify_student.0006_ssoverification... OK
  Applying verify_student.0007_idverificationaggregate... OK
  Applying verify_student.0008_populate_idverificationaggregate... OK
  Applying verify_student.0009_remove_id_verification_aggregate... OK
  Applying verify_student.0010_manualverification... OK
  Applying verify_student.0011_add_fields_to_sspv... OK
  Applying video_config.0001_initial... OK
  Applying video_config.0002_coursevideotranscriptenabledflag_videotranscriptenabledflag... OK
  Applying video_config.0003_transcriptmigrationsetting... OK
  Applying video_config.0004_transcriptmigrationsetting_command_run... OK
  Applying video_config.0005_auto_20180719_0752... OK
  Applying video_config.0006_videothumbnailetting_updatedcoursevideos... OK
  Applying video_config.0007_videothumbnailsetting_offset... OK
  Applying video_pipeline.0001_initial... OK
  Applying video_pipeline.0002_auto_20171114_0704... OK
  Applying video_pipeline.0003_coursevideouploadsenabledbydefault_videouploadsenabledbydefault... OK
  Applying waffle.0002_auto_20161201_0958... OK
  Applying waffle_utils.0001_initial... OK
  Applying wiki.0001_initial... OK
  Applying wiki.0002_remove_article_subscription... OK
  Applying wiki.0003_ip_address_conv... OK
  Applying wiki.0004_increase_slug_size... OK
  Applying wiki.0005_remove_attachments_and_images... OK
  Applying workflow.0001_initial... OK
  Applying workflow.0002_remove_django_extensions... OK
  Applying xapi.0001_initial... OK
  Applying xapi.0002_auto_20180726_0142... OK
  Applying xblock_django.0001_initial... OK
  Applying xblock_django.0002_auto_20160204_0809... OK
  Applying xblock_django.0003_add_new_config_models... OK
  Applying xblock_django.0004_delete_xblock_disable_config... OK
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform# ./manage.py lms create_oauth2_client \
>                   "http://androidapp.com" "http://androidapp.com/redirect" public \
>                   --client_id android --client_secret 5ouH4LSqLItP5uCKpEowmaPA \
>                   --trusted
WARNING:py.warnings:/openedx/edx-platform/lms/djangoapps/courseware/__init__.py:5: DeprecationWarning: Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported
  warnings.warn("Importing 'lms.djangoapps.courseware' as 'courseware' is no longer supported", DeprecationWarning)

2020-05-04 17:40:49,579 WARNING 395 [enterprise.utils] utils.py:50 - Could not import Registry from third_party_auth.provider
2020-05-04 17:40:49,579 WARNING 395 [enterprise.utils] utils.py:51 - cannot import name _LTI_BACKENDS
{
    "name": "", 
    "url": "http://androidapp.com", 
    "logout_uri": null, 
    "redirect_uri": "http://androidapp.com/redirect", 
    "client_id": "android", 
    "user": null, 
    "client_type": 1, 
    "client_secret": "5ouH4LSqLItP5uCKpEowmaPA"
}
root@lms-566df9fbfd-cxj9t:/openedx/edx-platform#        if [ -d /openedx/data/uploads/ ]; then
>                 if [ -n "$(ls -A /openedx/data/uploads/)" ]; then
>                   echo "Migrating LMS uploaded files to shared directory"
>                   mv /openedx/data/uploads/* /openedx/media/
>                   rm -rf /openedx/data/uploads/
>                 fi
>               fi

Basically it's just for the LMS but the CMS have the same issue.

If needed I can restart a clean deploy to get the jobs logs

regisb commented 4 years ago

The reason why you are getting this error message is that you are exec-ing in the docker containers. Thus, you bypass the docker entrypoint which defines the DJANGO_SETTINGS_MODULE environment variable. This environment variable tells django to load the production settings, which do not depend on the django debug toolbar (DDT). When this environment variable is absent, django loads the default settings, which are for development. Running the manage.py command then fails because the DDT requirements are not installed in the container.

If you really want to exec in the running container, you should then define the environment variable prior to running any manage.py command:

export DJANGO_SETTINGS_MODULE=tutor.production
./manage.py lms migrate

But this is just a workaround for the underlying issue, which is that the lms init job is failing. You should check the logs from this job to understand the underlying issue. As indicated, you can check the logs by running:

kubectl logs --namespace=openedx --follow $(kubectl get --namespace=openedx pods --selector=job-name=lms-job-20200504193148 -o=jsonpath="{.items[0].metadata.name}")

I'll close this for now. If you face another issue that you discover in the lms job logs, please first discuss it in the Tutor forums.