abrieff
commented
2 years ago In our discussion, somehow I'd missed final_qaqc
QAQC Table Columns
a. job_number, b. b_likely_occ_desc - checking occ_initial, occ_proposed, and job_desc, c. b_large_alt_reduction - Alteration where classa_net unit change < -5 d. b_nonres_with_units - nonresidential (according to occ_initial or proposed) with non-zero classa_init or _prop, e. units_co_prop_mismatch - checks for all new buildings/alterations places where classa_prop is not equal to co_latest_units, f. partially_complete - job status - 4. Partially Completed, g. units_init_null - demolitions and alterations in residential with null classa_init, h. units_prop_null - new buildings and alterations in residential with null proposed units, j. units_res_accessory - looks to be highlighting units around ADUs, either proposed or initially, k. outlier_demo_20plus - Demolitions where there are larger than 19 classa_init units in the building, l. outlier_nb_500plus - New Building where the number of classa_prop proposed units > 499, m. outlier_top_alt_increase - Whether its one of the 20 largest alterations by classa_net increase in units, n. dup_bbl_address_units, o. dup_bbl_address, p. inactive_with_update - Date Last Updated > Last Captured Updated Date and job_inactive is set to new value, q. no_work_job - checks against a number of job_descriptions and job types to determine if job has work to be done, r. geo_water - whether its in water s. geo_taxlot- if the bbl is missing t. geo_null_latlong - latlong is null u. geo_null_boundary - any of the boundaries (fire district, etc.) are missing v. invalid_date_filed - when last filed date is not a date or is before 1990, w. invalid_date_lastupdt - when last updated date '', x. invalid_date_statusd - when statusd date '', y. invalid_date_statusp - when statusp date '', z. invalid_date_statusr - when statusr date '', aa. invalid_date_statusx - when statusx date '', ab. incomp_tract_home - tracthomes flag is Y and job status in 1, 2, 3, ac. dem_nb_overlap - checking duplicates between new buildings and demolitions
AmandaDoyle
td928
SashaWeinstein
damonmcc
Proposed Work
New QAQC Table
DevDB Side
Because the existing QAQC is immutable, we would like to build a new QAQC report on top of it, which would accomplish two main goals: filtering out records with no flags, and attaching additional variables (Job Type, Job Status, etc.) for filtering on the app side.
App Side
Dataframe Display, with options to filter by key fields(Job Type, Job Status) and by flag type, to view the job numbers of records with each particular flag.
QAQC Version Aggregation Report
DevDB Side
New report that includes one row per version, and totals the number of records flagged per QAQC check.
App Side
Graphs displaying the # of flagged records for each version and QAQC check
QAQC Flag Change over Time
DevDB Side
Could use some direction on the exact format of this - the idea of checking how the flags on records change over time, and how that maps onto the manual review process (ie: Excluding records that have been checked and are known to be fine or fixed)
Field Distribution Reports
DevDB Side
For Job Status and Job Type, create a new report that includes the # of new records of each possible type created since the previous version, to be able to map over versions anomalies in the assigning of statuses or types
QAQC Side
Graph for each field showing the distribution of new records by field value, with multiple lines for previous versions
Complete Year/Complete Quarter Report
DevDB Side
There seem to be two separate checks here, one on a per-record basis, and one on the aggregate table.
App Side
Graph showing the distribution of completed records by quarter
ClassA_Net Check
DevDB Side
Add an additional flag to the new QAQC table for checking that classa_init - classa_prop = classa_net
Manual Corrections
App Side
Graphs and Dataframe Displays of Manual Corrections Applied and Not Applied by field