Because I could not determine the intended orchestration between the workflows that are supposed to take updates from the data model and send them (somehow?) to the data-dictionary repo to update the data dictionary website, this branch ended up being a major overhaul of the system in order to simplify the logic.
Currently, all changes to the data model AND the data dictionary website will occur in this repo
Currently, after editing data model attributes, the steps to update the full data model csv and convert to jsonld must be done manually; same with running the scripts to update the term pages for the Github pages dictionary website**
The gh pages deployment should still be automated on pushes to main**
I removed the data-dictionary submodule because I could not for the life of me understand how it was being used, and it made the maintenance of the data-models repo very complicated. If needed this could be reinstated later.
Summary of changes:
1. Workflow and Automation Adjustments:
Manual Workflow Implementation: Updated workflows to make dictionary processes manual, paused most automation (e.g., .github/workflows/update_data_model.yml, processes/dictionary_site_workflow.sh).
Simplification and Clarification: Simplified workflows, renamed workflows and directories for clarity, specified Python version and sub-packages for compatibility.
2. Documentation and Configuration Updates:
Documentation Removal and Updates: Removed unused Sphinx docs, added and updated various documentation files (e.g., docs/, dictionary-dev/).
Configuration and Dependencies: Updated Jekyll, modified configuration files, added dependencies from the data dictionary submodule (e.g., Gemfile.lock, pyproject.toml).
3. Data Model and Schema Management:
Data Dictionary Integration: Moved data dictionary scripts and data out of submodule, regenerated data models (e.g., _data/, EL.data.model.csv).
Because I could not determine the intended orchestration between the workflows that are supposed to take updates from the data model and send them (somehow?) to the data-dictionary repo to update the data dictionary website, this branch ended up being a major overhaul of the system in order to simplify the logic.
Currently, all changes to the data model AND the data dictionary website will occur in this repo
Currently, after editing data model attributes, the steps to update the full data model csv and convert to jsonld must be done manually; same with running the scripts to update the term pages for the Github pages dictionary website**
The gh pages deployment should still be automated on pushes to main**
I removed the data-dictionary submodule because I could not for the life of me understand how it was being used, and it made the maintenance of the data-models repo very complicated. If needed this could be reinstated later.
Summary of changes:
1. Workflow and Automation Adjustments:
.github/workflows/update_data_model.yml,processes/dictionary_site_workflow.sh).2. Documentation and Configuration Updates:
docs/,dictionary-dev/).Gemfile.lock,pyproject.toml).3. Data Model and Schema Management:
_data/,EL.data.model.csv).schematic_config.yml,.env).4. Asset and File Management:
assets/imgs/ELITE_logo.png).model-dev/,elite-data/).