search

CentralValleyModeling / wrims

5 stars 4 forks source link

Opening DSS files/catalogs in DSS perspective is very slow #167

Open dezidizon opened 1 week ago

dezidizon commented 1 week ago

This was originally reported by @hxiedwr in #163.

Opening DSS files/catalogs in DSS perspective is very slow.

@hxiedwr added:

For "(3) Opening dss files/catalogs in DSS perspective is very slow", we should follow the example of opening svar dss file in WRIMS-Core. The speed there is normal.

@hxiedwr also shared InstructionErrorCreated.docx

adamkorynta commented 1 week ago

@hxiedwr - I tested with an example DSS6 file that we used for EPPT that is ~700mb. I am seeing it taking over a minute to load the catalog. I converted the file to DSS7 and it then takes only 2 seconds.

This seems contradictory to your report saying that there was similar slowness with DSS6 and DSS7 is that correct?

hxiedwr commented 1 week ago

We have to focus on heclib 6 or heclib 7 generated 6 format also. CalSim users need time to adjust to heclib 7. So we have to make 6 format work fast from both heclib 6 and 7.

hxiedwr commented 1 week ago

Also I didn't say both 6 and 7 are slow. I just mentioned opening dss is slow in dss perspective in general. I mentioned 7 just to avoid opening 6 and 7 mixed.

adamkorynta commented 1 week ago

Thanks, Hao that was exactly what I was looking to clarify

adamkorynta commented 6 days ago

@hxiedwr - I looked into this a bit deeper after starting to recode all the HecDss references to our condensed cache mechanism. It still seems like DSS6 is an order of magnitude slower. I've reached out to HEC for some help and have a simple test to show them. The non-condensed cache works fast so I'm surprised by this impact.

hxiedwr commented 6 days ago

Thanks for the update.