NBISweden / swefreq

Swedish Frequency resource for genomics website
https://swefreq.nbis.se/
GNU General Public License v3.0
8 stars 1 forks source link

Feature/compute callcount #541

Closed MalinAhlberg closed 5 years ago

MalinAhlberg commented 5 years ago

Describe the pull request:

Pull request long description:

Move the calculation of callcount from psql to python import (--count_calls) This speeds up queries to the beacon metadata, which no longer needs to be materialized. Also improve the sql schema so that no views are materialized.

Changes made:

  1. Calculate the dataset's callcount and variantcount on import
  2. Make data_table a real table
  3. Stop materializing views
  4. Add better indices