laminlabs / lamindb-setup

Setup & configure LaminDB.
Apache License 2.0
4 stars 1 forks source link

CI started to hang #747

Open falexwolf opened 2 months ago

falexwolf commented 2 months ago

https://laminlabs.slack.com/archives/C04A0RMA0SC/p1715029957219169

I don't what happened but since today the CI starts hanging in instances.

Maybe it's related to not signing out of auth, I don't yet know. It's also a problem in lamindb.

image
falexwolf commented 2 months ago

In lamindb, almost all runs were canceled after 10 min and then they all started to pass again:

https://github.com/laminlabs/lamindb/pull/1619

image
Koncopd commented 2 months ago

Hm, what can it be. I A new release of some package related to the testing envs? I thought it could be nbclient, but no new releases recently. Also i saw hanging tests without any notebooks. Not sure how even to start investigating this.

falexwolf commented 2 months ago

Didn't see any hanging today: https://github.com/laminlabs/lamindb-setup/pull/749

falexwolf commented 2 months ago

Seeing it very rarely again on main:

https://github.com/laminlabs/lamindb-setup/actions/runs/8966614401/job/24622502660

falexwolf commented 2 months ago

Also randomly in lamindb:

image

Almost always after the tests ran through. 🤔

https://github.com/laminlabs/lamindb/actions/runs/8966710336/job/24622789392?pr=1622

Koncopd commented 2 months ago

Maybe a nox release?

falexwolf commented 2 months ago

Hits us less in lamindb-setup now, but quite a LOT in lamindb:

image