search

nautobot / nautobot-app-ssot

Single Source of Truth for Nautobot
https://docs.nautobot.com/projects/ssot/en/latest/
Other
38 stars 41 forks source link

Update the ExampleDataSource job to improve memory utilization #526

Closed gsnider2195 closed 3 months ago

gsnider2195 commented 3 months ago

This changes the NautobotRemote adapter to use a generator to process large lists of data instead of building a large list and returning it.

This also updates the logging output to be more human-readable.

Before

image

After

image

Also confirmed with docker stats that the container memory utilization only increased by ~110MiB after running the job