Fix SPARQLgraph (report) timeouts on big queries

ge-high-assurance / RACK

DARPA's Automated Rapid Certification of Software (ARCOS) project called Rapid Assurance Curation Kit (RACK)

BSD 3-Clause "New" or "Revised" License

20 stars 6 forks source link

Fix SPARQLgraph (report) timeouts on big queries #708

Closed cuddihyge closed 2 years ago

cuddihyge commented 2 years ago

Abha has found that 1. ingest_SWCOMPONENT times out inside a report. Further investigation has found several places in reports and regular SPARQLgraph that do not protect the browser from memory overruns due to very large query results.

report sections table_test_row_count
construct queries in reports
construct queries on the Query tab

cuddihyge commented 2 years ago

run ingest_SWCOMPONENT as

construct on the main query tab
a table inside a report
a table_test_row_count inside a report

In all cases the results now should be truncated and the browser survives without a memory overflow.

cuddihyge commented 2 years ago

Need to lower the concurrency in report generation. Abha has found that queries run fine individually but not concurrently (report gen runs a few at a time)