dagster for nsw-doe-data-stack-in-a-box-requires-secrets time out (gRPC Error code: UNAVAILABLE) - Githubissues

wisemuffin / nsw-doe-data-stack-in-a-box

Department of Education (DOE) for New South Wales (AUS) data stack in a box

https://nsw-doe-data-stack-in-a-box.vercel.app

MIT License

28 stars 0 forks source link

dagster for nsw-doe-data-stack-in-a-box-requires-secrets time out (gRPC Error code: UNAVAILABLE) #37

Open wisemuffin opened 1 month ago

wisemuffin commented 1 month ago

nsw-doe-data-stack-in-a-box-requires-secrets takes a while for the code repo to load so is failing quite ofter to finish within the aloted 60 seconds for each code location.

error: Error loading ***-requires-secrets: dagster._core.errors.DagsterUserCodeUnreachableError: User code server request timed out due to taking longer than 60 seconds to complete.

soloution: https://github.com/dagster-io/dagster/discussions/22992

to review the bottle neck: py-spy record -f speedscope --idle dagster dev

wisemuffin commented 1 month ago

for now have disabled the secret dagster workspace for deployments