Sluggish Performance On 2024.5 with statistics

[dannytsang]

The problem

I've noticed the performance since upgrading to 2024.5 has very poor compared to 2024.4.4. Symptoms I'm seeing include:

1. Longer loading times from a browser
2. Android mobile app taking longer to connect/load. At times, it times out or report SSL errors using nabu casa URL.
3. Add-ons fail to load and shows a blank page like VSCode.

All the above I experience using Nabu casa, local IP and reverse proxy address.

When I reboot the VM, the performance seems to come back and then slows overtime. I don't see it hitting 100% CPU like #116650

What version of Home Assistant Core has the issue?

2024.5.0 and 2024.5.1

What was the last working version of Home Assistant Core?

2024.4.4

What type of installation are you running?

Home Assistant OS

Integration causing the issue

No response

Link to integration documentation on our website

No response

Diagnostics information

No response

Example YAML snippet

No response

Anything in the logs that might be useful for us?

No response

Additional information

The behaviour is backed up uptime Kuma below. I upgraded on May 1st:

[dannytsang]

I ran the profiler as well at the time it was slow. callgrind.out.1714732238247953.txt

[joostlek]

[joostlek]

Something is calling _exact_ratio a lot of times

[dannytsang]

Is it related to a statistics sensor? Any ideas how I can hunt it down?

[joostlek]

I recently learned how to read this, so this is everything I can pull out, furthermore I am not sure how to trace this back to anything sensible 😂

[dannytsang]

lol thanks for the assist and honesty @joostlek . Praying for @bdraco to chime in.

[home-assistant[bot]]

Hey there @thomdietrich, mind taking a look at this issue as it has been labeled with an integration (statistics) you are listed as a code owner for? Thanks!

Code owner commands

Code owners of `statistics` can trigger bot actions by commenting: - `@home-assistant close` Closes the issue. - `@home-assistant rename Awesome new title` Renames the issue. - `@home-assistant reopen` Reopen the issue. - `@home-assistant unassign statistics` Removes the current integration label and assignees on the issue, add the integration domain after the command. - `@home-assistant add-label needs-more-information` Add a label (needs-more-information, problem in dependency, problem in custom component) to the issue. - `@home-assistant remove-label needs-more-information` Remove a label (needs-more-information, problem in dependency, problem in custom component) on the issue.

_{^{(message by CodeOwnersMention)}}

---

statistics documentation statistics source _{^{(message by IssueLinks)}}

[bdraco]

There are some prior issues https://github.com/home-assistant/core/issues/110433 https://github.com/home-assistant/core/issues/116650

[bdraco]

https://github.com/home-assistant/core/issues/116650 probably has the most information

[ayavilevich]

Something is calling _exact_ratio a lot of times

@dannytsang

Seems very similar to what I am experiencing with this version. See https://github.com/home-assistant/core/issues/116650#issuecomment-2093177277

Are you using MariaDB for your database or something else?

[dannytsang]

Something is calling _exact_ratio a lot of times

@dannytsang

Seems very similar to what I am experiencing with this version. See #116650 (comment)

Are you using MariaDB for your database or something else?

I am using MySQL.

[ayavilevich]

I am using MySQL.

So not the default SQLite, correct?

[dannytsang]

correct. I'm running MySQL 8.0.36

[netmikey]

I'm running the default SQLite and am experiencing the sluggish performance since 2024.5 as well. Running on an HA Blue.