search

bluesky / databroker

Unified API pulling data from multiple sources
https://blueskyproject.io/databroker
BSD 3-Clause "New" or "Revised" License
35 stars 47 forks source link

socket leak #454

Open gwbischof opened 5 years ago

gwbischof commented 5 years ago

This way opens new mongo sockets for each iteration cat = catalog['xyz'] for i in range(100): cat['id'].primary.read()

This way reuses the open sockets: cat = catalog['xyz'] () for i in range(100): cat['id'].primary.read()

I think this needs a little more investigation.

danielballan commented 5 years ago

I think this will be fixed by https://github.com/intake/intake/pull/335. We are currently not compatible with the intake master branch though, so we'll have to resolve whatever API change broke us before we can verify that.

gwbischof commented 5 years ago

list the number of mongo sockets: netstat | grep mongo | wc -l

gwbischof commented 5 years ago

https://github.com/intake/intake/pull/335 didn't fix this issue