search

chenejac / VIVOTestMigrationJIRANotClosed

0 stars 0 forks source link

VIVO-1743: Triple store performance test procedures #100

Open chenejac opened 4 years ago

chenejac commented 4 years ago

Andrew Woods (Migrated from VIVO-1743) said:

This task is create test sets / procedures for evaluating VIVO/triplestore performance characteristics.

There are four categories of tests that should be established:

The test sets and procedures should be documented in the wiki.

chenejac commented 4 years ago

Andrew Woods said:

Test should be performed on at least the following triple store configurations:

For ingest timing, the following procedure should be followed:

Using the following patch that adds log messages, the timings can be tracked by "grepping" the vivo.all.log file for the term "ingest". https://github.com/awoods/Vitro/commit/d54e0324eab69baab4a283f69bd79ff64d817820

chenejac commented 4 years ago

Benjamin Gross said:

Out of curiosity, how much memory do you have allocated to Tomcat?

chenejac commented 4 years ago

Andrew Woods said:

[~accountid:5bb229e412ef2d4bf3a2233d]:

chenejac commented 4 years ago

Andrew Woods said:

Procedures and results being documented on the wiki: https://wiki.lyrasis.org/display/VIVO/Performance+Testing

chenejac commented 4 years ago

Benjamin Gross said:

Do you have the search indexer enabled? If so, are you clearing the index before uploading the openvivo.ttl file? After uploading on my machine, the search indexer reports there are 4,427,505 records to index and it takes a long time. 

chenejac commented 4 years ago

Benjamin Gross said:

Also, has MySQL been tuned at all? [https://wiki.lyrasis.org/pages/viewpage.action?pageId=70588556]

chenejac commented 4 years ago

Andrew Woods said:

Search indexer was turned off and Solr was shut down... which resulted in log error messages.

No MySQL tuning... pure vanilla.

chenejac commented 4 years ago

Benjamin Gross said:

Ah okay, my machine isn't just scary slow. I updated the testing procedure page to say search indexing is also turned off. 

chenejac commented 4 years ago

Benjamin Gross said:

Also, do you get an error when you visit the site admin page with the reasoner turned off? I get

There was an error in the system.Error message: JFactTBoxReasonerModule has not been started.Stack trace (full trace available in the vivo log): java.lang.IllegalStateException: JFactTBoxReasonerModule has not been started. at edu.cornell.mannlib.vitro.webapp.tboxreasoner.impl.jfact.JFactTBoxReasonerModule.getStatus(JFactTBoxReasonerModule.java:60)

so I have to go straight to /uploadRDFForm

chenejac commented 4 years ago

Andrew Woods said:

I did not notice the log when navigating to SiteAdmin... but I am able to successfully navigate. It may be worth noting, I checked out the rel-1.11.0-maint branch for the tests.

chenejac commented 4 years ago

Andrew Woods said:

[~accountid:5bb229e412ef2d4bf3a2233d]: It would be interesting to know if your timing results were very different than those on the wiki: https://wiki.lyrasis.org/display/VIVO/Performance+Testing ..feel free to update the page.