spring-cloud / spring-cloud-dataflow

A microservices-based Streaming and Batch data processing in Cloud Foundry and Kubernetes
https://dataflow.spring.io
Apache License 2.0
1.11k stars 583 forks source link

Modifying view queries to improve performance in MySQL / MariaDB. #5988

Open peter-cheon opened 1 month ago

peter-cheon commented 1 month ago

When using the SCDF UI on an SCDF server based on MySQL / MariaDB, executing job executions becomes slow during pagination if there are thousands of job history records.

This occurs because job executions and other histories are basically exposed in descending order. Creating a view based on descending order can lead to performance improvements.

For reference, when an internal SCDF server had about 8,000 job history records, creating a descending order-based view reduced the pagination movement speed for the 8,000-item list from 30 seconds to 5 seconds.

This has only been verified in MySQL / MariaDB, so modifications for other databases have not been made.