search

gussmith23 / lakeroad-evaluation

MIT License
5 stars 0 forks source link

Nightly consistently runs more slowly than manual run #142

Closed gussmith23 closed 9 months ago

gussmith23 commented 9 months ago

The nightly takes ~5 hours, where a manual run can take ~2. It seems specifically like Lakeroad is slower during the nightlies.

Examples: a manual run from an afternoon: https://github.com/uwsampl/lakeroad-evaluation/actions/runs/7634396280

The nightly from that night: https://github.com/uwsampl/lakeroad-evaluation/actions/runs/7637199042

I can't even guess why this would be. Maybe it's a power throttling thing? But I would expect the whole eval to slow in that case; here, in this case it's only the Lakeroad portion that slows down.

gussmith23 commented 9 months ago

Looking at top during the eval, it seems like we're spending a lot of time in Racket while running Lakeroad tasks -- even for the Xilinx tasks, which are generally pretty quick in symbolic interpretation. Going to go into the image and see what's happening.

gussmith23 commented 9 months ago

It might be because we have the wrong Racket. Racket inside this image is 8.2, but we claim to use 8.9. How did this not manifest sooner?