setup instructions

[damonmcc]

instillations

• install VS Code (recommended) with extensions Python, ...
• install git (use bash)
• install python
• set port values
• clone repo

project setup

• install packages

general

Audience is city employees on PCs. The SCA multipliers repo may have more up-to-date instructions for PC setup.

random notes while doing setup

• python3 ... may not work, but python ... may always work
• data/source_data/ could have the PLACEHOLDER.TXT in it

[sf-dcp]

Notes after testing:

• stage_0/sanity_check.py

  1. Either remove inspect_remote_table() or upgrade duckdb

• stage_1/load.py

  1. Unable to download spatial extension (proxy env variable is present). Suggestion: maybe we scrape downloading spatial extension here completely because we don't use it.

  

  2. Same error when downloading Airbnb and taxi data.

• stage_2/load.py

  1. Same issue with the spatial extension as in the previous stage

TODO:

• [x] stage 1: spatial extension
• [x] stage 1: test downloading and running analysis in Jupyter notebook Airbnb & taxi data
• [x] stage 2: spatial extension
• [x] stage 2: update file names from Open Data in stage_2/load.py right before the presentation (they change)
• [x] stage 2: test load.py and other steps after addressing the spatial extension
• [ ] stage 3: still need to test

[sf-dcp]

Notes after testing (round 2)

• checked off some things from the todo list above

• created PR addressing some bugs

• stage 2 issues:

  • issue with explore notebook:

  • issue with analyze notebook:

• stage 3 issues:

  • issue when running dbt build:

    

  • how do we show that tables were created?