<img src="./img/tags/GAMECHANGER-NoPentagon_RGB@3x.png" align="right" alt="Mission Vision Icons" width="300" >
gamechanger-data
focuses on the data engineering work of gamechanger. To see all repositories gamechanger
DEPLOYMENT_ENV
variable and run ./paasJobs/configure_repo.sh
or paasJobs/configure_repo.bat
DEPLOYMENT_ENV=local ./paasJobs/configure_repo.sh
or set DEPLOYMENT_ENV=local \paasJobs\configure_repo.bat
gamechanger-data
repopython3 -m venv /opt/gc-venv-20210613
<venv>/bin/pip install --upgrade pip setuptools wheel
requirements.txt
, with no additional dependencies, e.g. <venv>/bin/pip install --no-deps -r requirements.txt
/opt/gc-venv-current
to the freshly created venv, e.g. ln -s /opt/gc-venv-20210613 /opt/gc-venv-current
env SCRIPT_ENV=<prod|dev> <repo>/paasJobs/configure_repo.sh
ocrmypdf
and its dependencies: https://ocrmypdf.readthedocs.io/en/latest/installation.html#installing-on-linuxbrew install tesseract-lang
https://docs.conda.io/en/latest/miniconda.html
conda create -n gc python=3.8
git clone ...; cd gamechanger
conda activate gc
pip install --upgrade pip setuptools wheel
pip install -e '.[dev]'
(quoting around .[dev] is important)https://docs.microsoft.com/en-us/windows/wsl/install-win10
https://docs.conda.io/en/latest/miniconda.html
conda create -n gc python=3.8
git clone ...; cd gamechanger-data
conda activate gc
pip install --upgrade pip setuptools wheel
pip install -e '.[dev]'
(quoting around .[dev] is important)Create venv
python -m venv [venv-name]
Activate
\[venv-name]\Scripts\activate
Update venv
python -m pip install --upgrade pip setuptools wheel
Install requirements.txt
pip install --no-deps -r dev_tools\requirements\gc-venv-current.txt
Run Configure Repo, Steps at the top of this README
To-Do:
docker build -t gc-data --no-cache .
docker rm -f gc-data-test || true
docker run -it --name gc-data gc-data
Configure Repo
Note: If you're using containerized env, you'll need Pro version of PyCharm and separate set of instructions - here
"Preferences -> Project -> Python Interpreter"
to the EXISTING gc
conda env you created. https://www.jetbrains.com/help/pycharm/conda-support-creating-conda-virtual-environment.html"Preferences -> Build, Execution, Deployment -> Console -> Python Console interpreter"
to your gc
conda interpreter env that you added earlier.Note: if you're using containerized env, you'll need setup like this
gc
venv as the python venv
https://code.visualstudio.com/docs/python/environmentsMy venv is broken somehow!
See LICENSE.md (including licensing intent - INTENT.md) and CONTRIBUTING.md