bacalhau-project / bacalhau

Compute over Data framework for public, transparent, and optionally verifiable computation
https://docs.bacalhau.org
Apache License 2.0
643 stars 85 forks source link

Engine, Storages, and Publisher provider `Keys()` method is slow #4153

Open frrist opened 6 days ago

frrist commented 6 days ago

These three lines each take between 3-10 seconds to evaluate: https://github.com/bacalhau-project/bacalhau/blob/ac1543484e66ea4c8e7304a45ef0147c416dae88/pkg/node/node.go#L188-L192 Hunch is this is related to check if different providers are installed via their respective IsInstalled method. Extra hunch its related to the S3 publisher and storage source checking if its credentials are valid.