visit-dav / visit

VisIt - Visualization and Data Analysis for Mesh-based Scientific Data
https://visit.llnl.gov
BSD 3-Clause "New" or "Revised" License
446 stars 117 forks source link

Unstructured ghost zone communication based on global node ids is too slow. #843

Open aowen87 opened 5 years ago

aowen87 commented 5 years ago

I received a file from an LLNL Ale3D user. The file appears to have no ghost zones but it does have global node ids and 16 domains. VisIt is very slow to plot volume_mesh from this file, which is a multimesh pointing to 16 ucdmeshes. When I timed VisIt and looked at the logs, I see the following: Timing for Finding nodes external to domain. took 0.023085Timing for Creating table of shared nodes. took 0.009059Timing for Setting up shared nodes list. took 17.952567Timing for Actual communication of ghost zones took 1.069168Timing for Time to actually communicate ghost data took 26.097817Timing for Deciding not to material select data took 0.000008Timing for Getting dataset for volume_mesh took 26.276077 I looked in the avtGenericDatabase class's CommunicateGhostZonesFromGlobalNodeIds method and that is where the slowness happens. Can this code be rewritten to be faster or simpler?

-----------------------REDMINE MIGRATION----------------------- This ticket was migrated from Redmine. As such, not all information was able to be captured in the transition. Below is a complete record of the original redmine ticket.

Ticket number: 832 Status: Pending Project: VisIt Tracker: Bug Priority: Normal Subject: Unstructured ghost zone communication based on global node ids is too slow. Assigned to: - Category: - Target version: - Author: Brad Whitlock Start: 08/29/2011 Due date: % Done: 0% Estimated time: Created: 08/29/2011 07:00 pm Updated: 09/16/2011 02:10 pm Likelihood: 2 - Rare Severity: 3 - Major Irritation Found in version: 2.3.0 Impact: Expected Use: OS: All Support Group: Any Description: I received a file from an LLNL Ale3D user. The file appears to have no ghost zones but it does have global node ids and 16 domains. VisIt is very slow to plot volume_mesh from this file, which is a multimesh pointing to 16 ucdmeshes. When I timed VisIt and looked at the logs, I see the following: Timing for Finding nodes external to domain. took 0.023085Timing for Creating table of shared nodes. took 0.009059Timing for Setting up shared nodes list. took 17.952567Timing for Actual communication of ghost zones took 1.069168Timing for Time to actually communicate ghost data took 26.097817Timing for Deciding not to material select data took 0.000008Timing for Getting dataset for volume_mesh took 26.276077 I looked in the avtGenericDatabase class's CommunicateGhostZonesFromGlobalNodeIds method and that is where the slowness happens. Can this code be rewritten to be faster or simpler?

Comments:

brugger1 commented 5 years ago

0843_run0016_0000.gz