search

WebCuratorTool / webcurator

The root of the webcurator tool project, containing all modules needed to run a fully functional webcurator tool.
Apache License 2.0
2 stars 1 forks source link

V3.1.4: vis treeview uplift #75

Closed leefrank9527 closed 1 year ago

leefrank9527 commented 1 year ago

Improved the performance of visualization feature:

  1. Refactored the Url, Folder and Domain entities to iterate the data fast.
  2. Changed the data loading mechanism of the folder treeview to lazy load.
  3. Reduced the loop times of the adjustment of the network map picture.
  4. Limited the size of the customized search result datasets. If the number of URLs exceeds 32K, it will warn the users to narrow the search conditions.
  5. Upgraded the Sleepycat(Berkley DB) to the latest version to reduce the size of BDB files.

Changed some repository URL as well, because some repos are not reachable. Mainly about the oracle jdbc driven and the webarchive-commons.

leefrank9527 commented 1 year ago

I updated the PR with the improvement of the oprations on treeview. It's allowed to prune, recrawl and export the selected URLs and all it's children.

hannakoppelaar commented 1 year ago

I've added the fix for #88: the Browse context menu now also has a link to the Access Tool. I've also removed the lingering HarvestResourceDTO class (the database table containing harvest resources has disappeared with v3.1), which fixes #86.