The goal of this project is to empower citizens to effectively organize for their quality of life in their cities and to ensure information about protests is accessible.
This project is under development and has three main parts - backend, frontend and crawler. Currently two separate packages live in this repository - server (which includes the crawler code) and client.
Things you need to install:
Run the following command to install the meirim
command-line application:
$ sudo ./cli/install_dev_env.sh
Once you have these you can clone the code:
$ git clone git@github.com:meirim-org/meirim.git
$ cd meirim
Cd into the package directory and install dependencies:
$ cd server
$ npm install
Connect to your MySQL instance:
$ mysql -u root -p
Create and setup a database for the project:
CREATE DATABASE meirim character set UTF8 collate utf8_bin;
SET GLOBAL sql_mode=(SELECT REPLACE(@@sql_mode,'ONLY_FULL_GROUP_BY,',''));
exit;
Edit your local configuration file and set your database connection details and email smtp settings (if needed). The default configuration files resides at server/config/default.json
. To override configuration values without accidentally committing them make a copy of the file at server/config/local.json
, delete whichever values you don't wish to override and leave the ones you do and change their values.
Run all database migrations:
$ $(npm bin)/knex migrate:latest
Finally, run the service:
$ npm start
The service will then be available on port 3001.
Cd into the package directory and install dependencies:
$ cd client
$ npm install
Nothing needs to be set up specifically for the frontend (however a working backend service would make it a bit more useful). It can be started using:
$ npm start
And will then be available at http://localhost:3000
Both the backend and the frontend should be run separately when developing for the auto-reload capabilities of webpack-dev-server. The backend will run on port 3001 by default, and the frontend will run on port 3000 and proxy requests destined to the backend from any path beginning with "/api" to the service at port 3001 (proxy settings live in client/src/setupProxy.js).
To run the crawler (for testing or seeding the database with plan data) you must first install all dependencies required by Chromium (which is used by puppeteer) which vary from system to system.
If puppeteer is not working properly, check the project's troubleshooting information.
To run the crawler after installing server dependencies and setting up a database (can be killed at any time using Ctrl+C):
$ cd server
$ npm run crawl
Tests require all prerequisites to be fulfilled and a database instance to be available at port 33060 on localhost. The odd port is for preventing people from running the tests on development databases accidentally (and can be changed by overriding the test section at server/config/default.json).
If you use docker to run the MYSQL, you may use this command to lift a docker for testing
docker run -p 3306:3306 -e MYSQL_ROOT_PASSWORD=password -d mysql:5.7
$ cd server
$ npm run test
Cypress is used for e2e tests and is meant to test the frontend and backend as served using the serve
script.
First build the frontend and run the serve script:
$ cd client
$ npm run build
$ cd ../server
$ npm run serve
Then the tests can be run (use a browser of your choice out of your installed browsers. To see which browsers cypress recognizes use $(npm bin)/cypress info
):
$ cd ../client
$ $(npm bin)/cypress run --browser chromium
We use pm2 to run the service in production.
First you must build the frontend react site, then the service (serving both the backend and frontend) can be started:
$ cd client
$ npm run build
$ cd ..
$ pm2 start ecosystem.config.js --env production
Set up cron to schedule three jobs - crawling for new data, emailing alerts to users and aggregating impressions:
$ crontab -e
*/40 * * * * cd /path_to_code/meirim/server && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/iplan >> /path_to_code/meirim/server/logs/combined.log
*/20 * * * * cd /path_to_code/meirim/server && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/plan_status_change >> /path_to_code/meirim/server/logs/combined.log 2>&1
0 10,21 * * SUN-THU cd /path_to_code/meirim/server && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/fetch_tree_permit >> /path_to_code/meirim/server/logs/combined.log 2>&1
*/50 * * * * cd /path_to_code/meirim/server && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/send_emails_trees >> /path_to_code/meirim/logs/combined.log 2>&1
*/50 * * * * cd /path_to_code/meirim/server && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/send_emails >> /path_to_code/meirim/logs/combined.log 2>&1
30 * * * * cd /path_to_code/meirim/ && NODE_ENV='production' /usr/bin/node /path_to_code/meirim/bin/aggregate_views >> /path_to_code/meirim/logs/combined.log 2>&1
You can find more technical info about the project under the docs folder.
We are thankful for any comments, suggestions, issue reports and pull requests anyone might wish to help with. We will do our best to acknowledge, review and reply to these contributions to the best of our abilities (we are all volunteers).
For methods of communicating with us, please see our website.
Issues are assigned a label 'Welcome' are suitable for first time contribution to meirim. You can see the full list here: https://github.com/meirim-org/meirim/labels/%F0%9F%99%8B%E2%80%8D%E2%99%80%EF%B8%8F%20Welcome
See the list of contributors who participated in this project <3.
This project is licensed under the MIT License - see the LICENSE.md file for details. The rest is licensed under a Creative Commons Attribution 4.0 International License.