CodeForAfrica / HURUmap

HURUmap is an interactive web platform that allows citizens and journalists to explore, visualise, and download census data. This gives them the power to give context to stories that was otherwise hard to spot. Accessible at https://hurumap.org
https://hurumap.org
GNU General Public License v3.0
8 stars 7 forks source link
africa census citizens dashboard django django-apps geo-datasets geographies hurumap journalists kenya nigeria python south-africa tanzania uganda wazimap zambia

HURUmap

HURUmap is an interactive web platform that allows citizens and journalists to explore, visualise, and download census data. This gives them the power to give context to stories that was otherwise hard to spot. Accessible at https://hurumap.org

Goals

Instead of re-inventing the wheel, HURUmap relies on the excellent Wazimap and Census Reporter projects and aims to do the following:

  1. Extend the features available e.g download SVG / PNG
  2. Provide a platform of shared data - tables and geographies (using mapit) that can be re-used with the different apps
  3. Provide shared styling, design, attribution, and other engagement content preferences

Usage

TODO: How to build HURUmap-powered apps using opinionated Docker.

Install HURUmap Django App / package

  1. Install the package

    pip install -e git+https://github.com/CodeForAfrica/HURUmap.git@master#egg=hurumap
    
  2. Add the app to installed apps

       INSTALLED_APPS = [
           ...,
           'hurumap'
       ]
  3. Add these to your settings.py

  4. Run migrations

       python manage.py migrate
  5. Create an admin user to access the CMS

      python manage.py createsuperuser
  6. Read the full Wazimap documentation to get started.


Contributing

To ease contribution, our key principles are borrowed from contrib where multiple programming languages and approaches can live together in harmony.

To this end, we've created a contrib folder that contains the following:

  1. Docker scripts for the Django apps powering majority of the backend
  2. Yarn implementation for the frontend pieces (coming soon?)
  3. Makefile in the root directory to tie it all together with easy tasks

For more details on contributing, please check out CONTRIBUTING.md.

Development

Django Apps

Quickly get started with HURUmap by running the following:

# 1. Build services:
make build

# 2. Start web server:
make web

# 3. In a new terminal window, load data:
make loaddata

Visit http://localhost:8000 to view website.

HURUmap Dashboard

HURUmap comes packaged with built-in CMS using Wagtail. To work with the dashboard:

# 1. Target and build docker image
export DOCKERFILE_TARGET="hurumap-dashboard"
make build

# 2. Start web server:
make web

# 3. In a new terminal window, create your first user:
make createsuperuser

Visit http://localhost:8000/dashboard to log into the dashboard.

To remove dashboard workings, stop all services and run;

unset DOCKERFILE_TARGET
make build
make web

NOTE: Unless you remove the database container, all the database tables and their data will remain intact.

Frontend UI

Hide Empty sections on the profile page

Use LOCATION_NOT_FOUND_DIST in HURUmap profile templates to either hide or call to action whenever there's a missing data.

If our data distribution is called budget, then our code that hides the viz whenever data is missing:

  {% if not budget.is_missing %}
    <article class="clearfix">
      <header class="section-contents">
        <h1>Budget</h1>
      </header>
      <div class="section-container">
        {% if not budget.government_expenditure_dist.is_missing %}
          <section class="clearfix stat-row">
            <h2 class="header-for-columns">Government Spending</h2>
            <div class="column-full"
                 id="chart-grouped_column-budget-government_expenditure_dist"
                 data-stat-type="scaled-percentage">
            </div>
          </section>
        {% endif %}
      </div>
    </article>
  {% endif %}

Multiple Chart Qualifiers Support

This version adds the ability to have more than one qualifier. Due to the HTML limitation of single data-qualifier attribute, the value of this attribute would need to be delimited to support multiple values. \n is used as delimiter.

... data-qualifier="GF: Global Fund\nADF: African Development Fund" data-...

By adding multiple qualifiers support, one can use qualifiers to add a legend to those charts, like histogram, that do not have a legend by default. This means shorter names can be used on the charts themselves leading to clean and easy to read charts.

Adding Data

Datasets and Releases

This HURUmap release takes advantage of datasets and releases for versioning data. A dataset is a collection of related data tables, such as a national census. A dataset can be updated with new releases every few years. Not all data data tables will always be updated in every release, so HURUmap lets you link data tables to releases individually.

Sometimes a release has a different name to the original dataset. For example, South Africa conducts a full census every decade, but releases a community survey in between each full census. A community survey is a statistical sampling and is not a full census, so it would be incorrect to call them both "census". The results of the community survey are very similar to the census and are directly comparable. We consider census and community surveys to be different releases of the same dataset.

You must add at least one dataset and one release before you can add any data tables. See below for details on how to do this.

Create a Dataset and Release
  1. Go to the Django admin section at http://localhost:8000/admin and log in.
  2. Under Wazimap, click the Add button alongside Datasets.
  3. Give your dataset a name.
  4. Under Releases, fill in the name and the year of your first release. For example, you could use Census and 2019.
  5. Click Save.
Configuring Tables

Datasets, releases and data tables are configured through the Django admin interface, at http://localhost:8000/admin.

Once you have told HURUmap about your tables, it'll ensure that they exist in the database. You can then import the raw data from CSV.

Adding custom styles to your embeds

You can customize the styles of your iframe embed by creating a .css file in your static directory and you append it to the iframe link like this <iframe ... src="https://github.com/CodeForAfrica/HURUmap/raw/master/.. &stylesheet=/static/css/embed_test.css" ... ></iframe>

Deployment

HURUmap Basic

TODO

HURUmap Dashboard

TODO

Static and Media Files deployment

Set these environment variables:

USE_S3 = True
AWS_ACCESS_KEY_ID = ...
AWS_SECRET_ACCESS_KEY = ...
AWS_STORAGE_BUCKET_NAME = ...
AWS_S3_REGION_NAME = ...

License

GNU GPLv3

Copyright (C) 2018 Code for Africa

This program is free software: you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program. If not, see https://www.gnu.org/licenses/.