search

TACC / tacc_stats

TACC Stats is an automated resource-usage monitoring and analysis package.
GNU Lesser General Public License v2.1
42 stars 15 forks source link

Speedup query time #64

Open aruhela opened 1 month ago

aruhela commented 1 month ago

There are couple of things that can be done here. Feel free to add more.

  1. Filter out data which is least viewed or of less interests to the users.
  2. Use Ajax instead of Python web interface
  3. Some preprocessing of data at server end
  4. Processing data at client end. (This might be part of 2)
  5. New Indexing
  6. New DB design (not required as of now)
  7. Tuning Postgres for load sharing and scalability
stephenlienharrell commented 2 weeks ago

Updating from psycopg2 to psycopg3 (and removing pgcopy), will allow async copies which should speed up the db