Initial loading is still slow despite including data for trips-table from the last 7 days only

[achasmita]

• I checked on staging and noticed that it is taking time while loading data page.
• The data page initially load uuid-table
  • In uuid table only data for update_ts, user_id, user_token are stored initially
  • Other columns are loaded only after user select the respective tab or initially data-page
    • And it calls add_user_stats function only after that which provides data for all the columns of table.
    • This function is used to get all the other data for column like total_tips, labeled_trips, first_trip,........
  • As the other columns for trips table are not stored and loaded only when UUIDs tab is selected, it is consuming time while we switch back to UUIDs tab from other tabs.

Here are the possible solutions:

• Reducing the data on uuid-table, maybe display 20-25 data at the begining and allow user to load more data.
• Reduce data and load all columns initially and store it, instead of calling it when tab is selected. So that it will not consume much time while switching between tabs.

[achasmita]

@shankari any suggestion?

[shankari]

• It is not just loading the data table that is slow. Even just logging in to the dashboard with the summary page is slow.
• I don't think that those are the only two solutions. "As the other columns for trips table are not stored and loaded only when UUIDs tab is selected," a simple fix would be to store the other columns. Note that this should be "other columns for the UUID table".

Can you also discuss this with @JGreenlee and come up with a solution jointly?

[JGreenlee]

Since I was testing the trip time page, which is outdated and doesn't have the 1 week filter, it was of course slow. I've yet to try the staging dataset on a more up-to-date branch. Let me try doing that and see if I can get a better understanding of the slowness

[JGreenlee]

• It is not just loading the data table that is slow. Even just logging in to the dashboard with the summary page is slow.

This isn't what I observed on master with staging data. The "Overview" page consistently loads in about 3 seconds for me. The dump that I am using has about 40 users and 3000 trips. Might that not be enough to notice the slowness?

The "Data" page takes 20 seconds to load.

[JGreenlee]

I've just realized that was with "Exclude test users" enabled.

Without test users excluded, there are about twice as many users and trips. The "Data" page takes about twice as long to load. The "Overview" page still takes about 3 seconds.

[shankari]

@JGreenlee and @achasmita you should retry on the staging server. I just retried and it took ~ 45 seconds to load the overview page. Note that in staging/production, we don't use a DB that runs on the same host as the code, and DB accesses are significantly slower.

@JGreenlee you should have access to the staging logs through AWS cloudwatch. @achasmita should have a staging login. We can also add a cognito login for Jack on staging, please let me know if you need help for this.