NYCPlanning / db-safegraph

SafeGraph ETL
4 stars 1 forks source link

db-safegraph

Note:

Instructions

  1. Install dependencies
    pip3 install -r requirements.txt
  2. Install cli autocomplete
    ./sg --install-completion
  3. Run a recipes (when you hit TAB there should be a list of available recipe names, autocomplete is availble here)
    ./sg run [TAB]

Note: type ./sg --help to get a list of available comamnds


Usage: sg [OPTIONS] COMMAND [ARGS]...

Options: --install-completion Install completion for the current shell. --show-completion Show completion for the current shell, to copy it or customize the installation.

--help Show this message and exit.

Commands: run Running an Athena recipe in the ./recipes folder setup Install minio and set up the accounts we need sync Syncing a safegraph data source, under the ./_sync folder



## Resources
- [Data Science Resources](https://docs.safegraph.com/docs/data-science-resources)
- [Colab - Quantifying Sampling Bias in SafeGraph Patterns](https://colab.research.google.com/drive/1u15afRytJMsizySFqA2EPlXSh3KTmNTQ#sandboxMode=true&scrollTo=WUWFYLLXowUJ)