search

home-assistant / core

:house_with_garden: Open source home automation that puts local control and privacy first.
https://www.home-assistant.io
Apache License 2.0
73.82k stars 30.91k forks source link

Memory leak in new version 2021.2.0 #45959

Closed McGiverGim closed 3 years ago

McGiverGim commented 3 years ago

The problem

Since the installation of the new version, it seems there is a memory leak. I attach an image later. The memory grows continuously and it restarts itself when full.

What is version of Home Assistant Core has the issue?

core-2021.2.0

What was the last working version of Home Assistant Core?

core-2021.1.5

What type of installation are you running?

Home Assistant OS

Integration causing the issue

Unknown

Link to integration documentation on our website

No response

Example YAML snippet

None

Anything in the logs that might be useful for us?

None

Image of the memory consumption:

image

McGiverGim commented 3 years ago

Here I attach a profiler of the memory of about 30 minutes. I don't know if it can help or I can do something before returning to older version. heap_profile.1612436628093493.hpy.zip

McGiverGim commented 3 years ago

Here the log produced after some minutes of profiler.start_log_objects, but I don't know what must I dump.

2021-02-04 12:51:13 CRITICAL (SyncWorker_14) [homeassistant.components.profiler] Memory Growth: [('dict', 302376, 302376), ('list', 216296, 216296), ('function', 85853, 85853), ('tuple', 83251, 83251), ('LRItem', 81729, 81729), ('cell', 36693, 36693), ('Production', 27054, 27054), ('weakref', 26609, 26609), ('method', 18157, 18157), ('type', 18150, 18150), ('Element', 15624, 15624), ('set', 13975, 13975), ('OidOrderedDict', 11529, 11529), ('builtin_function_or_method', 9089, 9089), ('getset_descriptor', 7413, 7413), ('Sequence', 5758, 5758), ('MibIdentifier', 5508, 5508), ('MibScalar', 4860, 4860), ('property', 4449, 4449), ('OrderedDict', 3730, 3730), ('MibTableColumn', 3564, 3564), ('ConstraintsIntersection', 3524, 3524), ('Counter32', 3242, 3242), ('wrapper_descriptor', 3118, 3118), ('method_descriptor', 3042, 3042), ('module', 2977, 2977), ('ModuleSpec', 2963, 2963), ('SourceFileLoader', 2782, 2782), ('Message', 2494, 2494), ('Any', 2482, 2482), ('member_descriptor', 2453, 2453), ('ObjectName', 2432, 2432), ('AnyType', 2400, 2400), ('Schema', 2236, 2236), ('ValueSizeConstraint', 2194, 2194), ('AnyAttribute', 2166, 2166), ('HassJob', 2069, 2069), ('ObjectIdentity', 1944, 1944), ('ComplexType', 1900, 1900), ('Cache', 1701, 1701), ('Node', 1628, 1628), ('Attribute', 1386, 1386), ('All', 1324, 1324), ('staticmethod', 1243, 1243), ('ObjectGroup', 1134, 1134), ('PathMetadata', 1096, 1096), ('DistInfoDistribution', 1095, 1095), ('ValueRangeConstraint', 1072, 1072), ('frozenset', 1071, 1071), ('SnmpAdminString', 1057, 1057), ('Optional', 1018, 1018), ('Integer32', 975, 975), ('_GenericAlias', 964, 964), ('DocumentMessage', 950, 950), ('instancemethod', 909, 909), ('AbstractMessage', 860, 860), ('MessagePart', 860, 860), ('InstanceState', 832, 832), ('classmethod', 823, 823), ('VarBind', 822, 822), ('Null', 820, 820), ('ObjectSyntax', 812, 812), ('SimpleSyntax', 812, 812), ('ObjectType', 810, 810), ('AIOGitHubAPIRepositoryTreeContent', 734, 734), ('ModuleIdentity', 729, 729), ('ModuleCompliance', 729, 729), ('RepositoryData', 719, 719), ('RepositoryContent', 719, 719), ('RepositoryInformation', 719, 719), ('RepositoryStatus', 719, 719), ('Validate', 719, 719), ('RepositoryReleases', 719, 719), ('RepositoryVersions', 719, 719), ('RepositoryPath', 719, 719), ('HacsManifest', 719, 719), ('Context', 700, 700), ('UUID', 698, 698), ('mappingproxy', 695, 695), ('deque', 692, 692), ('_tuplegetter', 675, 675), ('Parameter', 668, 668), ('ABCMeta', 628, 628), ('MibTableRow', 567, 567), ('MibTable', 567, 567), ('State', 554, 554), ('Required', 527, 527), ('itemgetter', 521, 521), ('Logger', 517, 517), ('OctetString', 511, 511), ('cython_function_or_method', 487, 487), ('FileFinder', 462, 462), ('HacsIntegration', 450, 450), ('EntitySubscription', 450, 450), ('ObjectIdentifier', 444, 444), ('MQTTMatcher', 430, 430), ('Subscription', 428, 428), ('Events', 417, 417), ('NamedValues', 415, 415), ('States', 414, 414)]
2021-02-04 12:51:48 CRITICAL (SyncWorker_1) [homeassistant.components.profiler] Memory Growth: [('OrderedDict', 3741, 11), ('SimpleItem', 12, 4), ('function', 85856, 3), ('cython_function_or_method', 490, 3), ('cell', 36695, 2), ('ItemList', 10, 2), ('Message', 2496, 2), ('HassJob', 2071, 2), ('TimerHandle', 91, 1), ('TopicExpressionType', 9, 1), ('NotificationMessageHolderType', 9, 1), ('PullMessagesResponse', 4, 1), ('__pyx_scope_struct____init__', 5, 1), ('StreamReader', 2, 1), ('list_iterator', 2, 1), ('LogEntry', 29, 1), ('UrlMappingMatchInfo', 3, 1), ('DNSService', 11, 1), ('PayloadAccessError', 1, 1), ('DNSAddress', 4, 1)]
2021-02-04 12:52:18 CRITICAL (SyncWorker_15) [homeassistant.components.profiler] Memory Growth: [('UPNPEntry', 22, 22), ('cell', 36709, 14), ('builtin_function_or_method', 9098, 9), ('function', 85863, 7), ('OrderedDict', 3745, 4), ('Future', 31, 3), ('DNSService', 14, 3), ('RequestsCookieJar', 4, 2), ('DefaultCookiePolicy', 22, 2), ('CaseInsensitiveDict', 4, 2), ('Condition', 89, 2), ('deque', 694, 2), ('socket', 41, 2), ('Lock', 178, 2), ('State', 556, 2), ('_WorkItem', 3, 2), ('HTTPHeaderDict', 1, 1), ('HTTPResponse', 7, 1), ('Response', 2, 1), ('GzipDecoder', 1, 1), ('_GeneratorContextManager', 6, 1), ('managedbuffer', 2, 1), ('memoryview', 2, 1), ('BufferedReader', 2, 1), ('mappingproxy', 696, 1), ('ConnectionState', 13, 1), ('Cookie', 2, 1), ('Request', 6, 1), ('StreamWriter', 4, 1), ('Connection', 2, 1), ('DNSAddress', 5, 1), ('PreparedRequest', 1, 1), ('SocketIO', 1, 1), ('_GatheringFuture', 1, 1), ('SocketStream', 1, 1), ('AsyncHTTP11Connection', 1, 1), ('ReceiveBuffer', 1, 1)]
2021-02-04 12:52:49 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: [('ObjectIdentity', 1954, 10), ('ObjectType', 820, 10), ('HassJob', 2075, 4), ('DirMibSource', 327, 3), ('Message', 2499, 3), ('MQTTMessage', 2, 2), ('MQTTMessageInfo', 2, 2), ('TaskStepMethWrapper', 2, 1), ('builtin_function_or_method', 9099, 1), ('BrotherDataUpdateCoordinator', 82, 1), ('Brother', 82, 1), ('Debouncer', 86, 1), ('SnmpEngine', 82, 1), ('MetaObserver', 82, 1), ('MsgAndPduDispatcher', 82, 1), ('MibBuilder', 82, 1), ('MibInstrumController', 82, 1), ('tuple_iterator', 2, 1), ('list_iterator', 3, 1)]
2021-02-04 12:53:18 CRITICAL (SyncWorker_11) [homeassistant.components.profiler] Memory Growth: [('dict', 304872, 2496), ('list', 218434, 2138), ('LRItem', 82738, 1009), ('Production', 27388, 334), ('function', 86057, 194), ('tuple', 83423, 172), ('method', 18287, 130), ('OidOrderedDict', 11644, 115), ('MibIdentifier', 5576, 68), ('MibScalar', 4920, 60), ('type', 18199, 49), ('set', 14020, 45), ('MibTableColumn', 3608, 44), ('ConstraintsIntersection', 3567, 43), ('Counter32', 3282, 40), ('ObjectName', 2462, 30), ('ValueSizeConstraint', 2221, 27), ('Cache', 1722, 21), ('ObjectIdentity', 1968, 14), ('ObjectGroup', 1148, 14), ('cell', 36722, 13), ('ValueRangeConstraint', 1085, 13), ('Integer32', 987, 12), ('weakref', 26619, 10), ('Null', 830, 10), ('SimpleSyntax', 822, 10), ('ObjectSyntax', 822, 10), ('SnmpAdminString', 1066, 9), ('ModuleIdentity', 738, 9), ('ModuleCompliance', 738, 9), ('OrderedDict', 3752, 7), ('MibTableRow', 574, 7), ('MibTable', 574, 7), ('OctetString', 517, 6), ('NamedValues', 420, 5), ('SingleValueConstraint', 412, 5), ('DisplayString', 410, 5), ('getset_descriptor', 7417, 4), ('ObjectIdentifier', 448, 4), ('SnmpEngineID', 328, 4), ('KeyChange', 328, 4), ('deque', 697, 3), ('Integer', 319, 3), ('MibTree', 246, 3), ('NotificationType', 246, 3), ('PyPackageSearcher', 246, 3), ('TestAndIncr', 246, 3), ('StorageType', 328, 3), ('ConstraintsUnion', 246, 3), ('TimeTicks', 171, 2), ('Message', 2501, 2), ('Vacm', 164, 2), ('TimeInterval', 164, 2), ('TDomain', 164, 2), ('SnmpSecurityLevel', 164, 2), ('SnmpSecurityModel', 164, 2), ('SnmpMessageProcessingModel', 164, 2), ('NotificationGroup', 164, 2), ('FileReader', 164, 2), ('TimeStamp', 164, 2), ('SnmpEngineTime', 164, 2), ('AutonomousType', 164, 2), ('staticmethod', 1244, 1), ('SplitResult', 25, 1), ('WSMessage', 7, 1), ('Lexer', 84, 1), ('LRParser', 83, 1), ('socket', 42, 1), ('SelectorKey', 13, 1), ('CIMultiDict', 13, 1), ('IpAddress', 86, 1), ('PDUs', 85, 1), ('ScopedPDU', 83, 1), ('ResponseHandler', 3, 1), ('MibViewController', 82, 1), ('SnmpV1MessageProcessingModel', 82, 1), ('SnmpV2cMessageProcessingModel', 82, 1), ('SnmpV3MessageProcessingModel', 82, 1), ('SnmpV1SecurityModel', 82, 1), ('SnmpV2cSecurityModel', 82, 1), ('SnmpUSMSecurityModel', 82, 1), ('SNMPv3Message', 82, 1), ('UsmSecurityParameters', 82, 1), ('UdpTransportAddress', 82, 1), ('Unsigned32', 82, 1), ('MibCompiler', 82, 1), ('DirMibSource', 328, 1), ('SnmpUDPAddress', 82, 1), ('PySnmpCodeGen', 82, 1), ('SymtableCodeGen', 82, 1), ('PyFileWriter', 82, 1), ('StubSearcher', 82, 1), ('RowStatus', 328, 1), ('RowPointer', 82, 1), ('SmiParser', 82, 1), ('SmiLexer', 82, 1), ('ConnectionKey', 2, 1), ('HttpResponseParser', 2, 1), ('_SSLProtocolTransport', 1, 1), ('StreamReader', 3, 1)]
2021-02-04 12:53:48 CRITICAL (SyncWorker_15) [homeassistant.components.profiler] Memory Growth: [('OrderedDict', 3759, 7), ('TimerHandle', 97, 6), ('memoryview', 4, 2), ('Message', 2503, 2), ('CastMessage', 1, 1), ('NullMessageListener', 3, 1), ('_Listener', 3, 1), ('weakproxy', 3, 1), ('WSMessage', 8, 1), ('Event', 282, 1)]
2021-02-04 12:54:18 CRITICAL (SyncWorker_11) [homeassistant.components.profiler] Memory Growth: [('dict', 304923, 51), ('LP_ifaddrs', 41, 41), ('ifaddrs', 40, 40), ('IP', 23, 22), ('set', 14037, 17), ('Adapter', 16, 16), ('weakref', 26634, 15), ('method', 18296, 9), ('tuple', 83424, 1), ('Lock', 179, 1), ('ContentLengthWriter', 1, 1), ('async_generator', 2, 1), ('Data', 2, 1), ('SplitResult', 26, 1)]
2021-02-04 12:54:48 CRITICAL (SyncWorker_2) [homeassistant.components.profiler] Memory Growth: [('dict', 307662, 2739), ('list', 220601, 2167), ('LRItem', 83747, 1009), ('Production', 27722, 334), ('function', 86245, 188), ('method', 18477, 181), ('OidOrderedDict', 11813, 169), ('tuple', 83591, 167), ('set', 14146, 109), ('MibIdentifier', 5644, 68), ('weakref', 26694, 60), ('MibScalar', 4980, 60), ('type', 18248, 49), ('MibTableColumn', 3652, 44), ('ConstraintsIntersection', 3610, 43), ('Counter32', 3322, 40), ('ObjectName', 2492, 30), ('ValueSizeConstraint', 2248, 27), ('ObjectIdentity', 1992, 24), ('Cache', 1743, 21), ('VarBind', 842, 20), ('SnmpAdminString', 1083, 17), ('ObjectGroup', 1162, 14), ('ValueRangeConstraint', 1098, 13), ('Integer32', 999, 12), ('Null', 840, 10), ('ObjectSyntax', 832, 10), ('SimpleSyntax', 832, 10), ('ObjectType', 830, 10), ('ModuleIdentity', 747, 9), ('ModuleCompliance', 747, 9), ('MibScalarInstance', 359, 8), ('OrderedDict', 3766, 7), ('MibTableRow', 581, 7), ('MibTable', 581, 7), ('RowStatus', 335, 7), ('Context', 706, 6), ('OctetString', 523, 6), ('TaskStepMethWrapper', 7, 5), ('NamedValues', 425, 5), ('SingleValueConstraint', 417, 5), ('DisplayString', 415, 5), ('StorageType', 333, 5), ('Handle', 29, 4), ('getset_descriptor', 7421, 4), ('ObjectIdentifier', 452, 4), ('SnmpEngineID', 332, 4), ('DirMibSource', 332, 4), ('TAddress', 168, 4), ('KeyChange', 332, 4), ('Integer', 322, 3), ('MibTree', 249, 3), ('NotificationType', 249, 3), ('PyPackageSearcher', 249, 3), ('TestAndIncr', 249, 3), ('ConstraintsUnion', 249, 3), ('TimerHandle', 99, 2), ('GetRequestPDU', 88, 2), ('VarBindList', 88, 2), ('Task', 27, 2), ('HassJob', 2077, 2), ('TimeTicks', 173, 2), ('Vacm', 166, 2), ('TimeInterval', 166, 2), ('TDomain', 166, 2), ('SnmpSecurityLevel', 166, 2), ('SnmpSecurityModel', 166, 2), ('SnmpMessageProcessingModel', 166, 2), ('NotificationGroup', 166, 2), ('FileReader', 166, 2), ('TimeStamp', 166, 2), ('SnmpEngineTime', 166, 2), ('SnmpTagList', 84, 2), ('SnmpTagValue', 84, 2), ('AutonomousType', 166, 2), ('PDUs', 86, 1), ('RenderInfo', 26, 1), ('frozenset', 1072, 1), ('staticmethod', 1245, 1), ('Lexer', 85, 1), ('LRParser', 84, 1), ('Debouncer', 87, 1), ('IpAddress', 87, 1), ('ScopedPDU', 84, 1), ('BrotherDataUpdateCoordinator', 83, 1), ('Brother', 83, 1), ('SnmpEngine', 83, 1), ('MetaObserver', 83, 1), ('MsgAndPduDispatcher', 83, 1), ('MibViewController', 83, 1), ('SnmpV1MessageProcessingModel', 83, 1), ('SnmpV2cMessageProcessingModel', 83, 1), ('SnmpV3MessageProcessingModel', 83, 1), ('SnmpV1SecurityModel', 83, 1), ('SnmpV2cSecurityModel', 83, 1), ('SnmpUSMSecurityModel', 83, 1), ('MibInstrumController', 83, 1), ('MibBuilder', 83, 1), ('SNMPv3Message', 83, 1), ('UsmSecurityParameters', 83, 1)]
2021-02-04 12:55:18 CRITICAL (SyncWorker_5) [homeassistant.components.profiler] Memory Growth: [('tuple', 83650, 59), ('TimerHandle', 120, 21), ('Context', 724, 18), ('set', 14164, 18), ('method', 18494, 17), ('weakref', 26705, 11), ('OrderedDict', 3770, 4), ('function', 86247, 2), ('States', 416, 2), ('SplitResult', 27, 1), ('URL', 30, 1), ('CIMultiDictProxy', 6, 1), ('RawRequestMessage', 6, 1), ('StreamWriter', 5, 1), ('Request', 7, 1), ('Future', 32, 1), ('Lock', 180, 1), ('InstanceState', 833, 1), ('Message', 2504, 1)]
2021-02-04 12:55:48 CRITICAL (SyncWorker_0) [homeassistant.components.profiler] Memory Growth: [('InstanceState', 849, 16), ('set', 14178, 14), ('weakref', 26716, 11), ('States', 424, 8), ('Events', 424, 7), ('method', 18500, 6), ('partial', 179, 1)]
2021-02-04 12:56:18 CRITICAL (SyncWorker_8) [homeassistant.components.profiler] Memory Growth: [('tuple', 83665, 15), ('OrderedDict', 3781, 11), ('method', 18508, 8), ('cell', 36728, 6), ('function', 86250, 3), ('weakref', 26718, 2), ('set', 14180, 2), ('Message', 2506, 2), ('HassJob', 2078, 1), ('Headers', 20, 1)]
2021-02-04 12:56:48 CRITICAL (SyncWorker_14) [homeassistant.components.profiler] Memory Growth: [('dict', 310237, 2575), ('list', 222697, 2096), ('LRItem', 84756, 1009), ('Production', 28056, 334), ('tuple', 83868, 203), ('function', 86432, 182), ('method', 18672, 164), ('OidOrderedDict', 11928, 115), ('set', 14284, 104), ('MibIdentifier', 5712, 68), ('MibScalar', 5040, 60), ('type', 18297, 49), ('weakref', 26763, 45), ('MibTableColumn', 3696, 44), ('ConstraintsIntersection', 3653, 43), ('Counter32', 3362, 40), ('Handle', 67, 38), ('ObjectName', 2522, 30), ('ValueSizeConstraint', 2275, 27), ('ObjectIdentity', 2016, 24), ('Cache', 1764, 21), ('ObjectGroup', 1176, 14), ('ValueRangeConstraint', 1111, 13), ('Integer32', 1011, 12), ('Null', 850, 10), ('SimpleSyntax', 842, 10), ('ObjectSyntax', 842, 10), ('ObjectType', 840, 10), ('SnmpAdminString', 1092, 9), ('ModuleIdentity', 756, 9), ('ModuleCompliance', 756, 9), ('State', 563, 7), ('mappingproxy', 703, 7), ('MibTableRow', 588, 7), ('MibTable', 588, 7), ('Context', 730, 6), ('Event', 288, 6), ('OctetString', 529, 6), ('NamedValues', 430, 5), ('SingleValueConstraint', 422, 5), ('DisplayString', 420, 5), ('getset_descriptor', 7425, 4), ('ObjectIdentifier', 456, 4), ('SnmpEngineID', 336, 4), ('DirMibSource', 336, 4), ('KeyChange', 336, 4), ('OrderedDict', 3784, 3), ('Integer', 325, 3), ('MibTree', 252, 3), ('NotificationType', 252, 3), ('PyPackageSearcher', 252, 3), ('TestAndIncr', 252, 3), ('StorageType', 336, 3), ('ConstraintsUnion', 252, 3), ('HassJob', 2080, 2), ('TimeTicks', 175, 2), ('Vacm', 168, 2), ('TimeInterval', 168, 2), ('TDomain', 168, 2), ('SnmpSecurityLevel', 168, 2), ('SnmpSecurityModel', 168, 2), ('SnmpMessageProcessingModel', 168, 2), ('NotificationGroup', 168, 2), ('FileReader', 168, 2), ('TimeStamp', 168, 2), ('SnmpEngineTime', 168, 2), ('AutonomousType', 168, 2), ('staticmethod', 1246, 1), ('Lexer', 86, 1), ('LRParser', 85, 1), ('Lock', 181, 1), ('Debouncer', 88, 1), ('IpAddress', 88, 1), ('PDUs', 87, 1), ('ScopedPDU', 85, 1), ('BrotherDataUpdateCoordinator', 84, 1), ('Brother', 84, 1), ('SnmpEngine', 84, 1), ('MetaObserver', 84, 1), ('MsgAndPduDispatcher', 84, 1), ('MibViewController', 84, 1), ('SnmpV1MessageProcessingModel', 84, 1), ('SnmpV2cMessageProcessingModel', 84, 1), ('SnmpV3MessageProcessingModel', 84, 1), ('SnmpV1SecurityModel', 84, 1), ('SnmpV2cSecurityModel', 84, 1), ('SnmpUSMSecurityModel', 84, 1), ('MibInstrumController', 84, 1), ('MibBuilder', 84, 1), ('SNMPv3Message', 84, 1), ('UsmSecurityParameters', 84, 1), ('UdpTransportAddress', 84, 1), ('Unsigned32', 84, 1), ('MibCompiler', 84, 1), ('SnmpUDPAddress', 84, 1), ('PySnmpCodeGen', 84, 1), ('SymtableCodeGen', 84, 1), ('PyFileWriter', 84, 1), ('StubSearcher', 84, 1), ('RowStatus', 336, 1)]
2021-02-04 12:57:18 CRITICAL (SyncWorker_14) [homeassistant.components.profiler] Memory Growth: [('list', 222711, 14), ('function', 86441, 9), ('cell', 36734, 6), ('OrderedDict', 3787, 3), ('Timeout', 28, 3), ('Url', 1, 1), ('traceback', 3, 1), ('TypeError', 1, 1), ('HassJob', 2081, 1)]
2021-02-04 12:57:47 CRITICAL (SyncWorker_10) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 12:58:18 CRITICAL (SyncWorker_7) [homeassistant.components.profiler] Memory Growth: [('dict', 313061, 2824), ('list', 224947, 2236), ('LRItem', 85765, 1009), ('Production', 28390, 334), ('tuple', 84078, 210), ('function', 86633, 192), ('method', 18845, 173), ('OidOrderedDict', 12097, 169), ('set', 14381, 97), ('MibIdentifier', 5780, 68), ('MibScalar', 5100, 60), ('type', 18346, 49), ('weakref', 26808, 45), ('MibTableColumn', 3740, 44), ('ConstraintsIntersection', 3696, 43), ('Counter32', 3402, 40), ('ObjectName', 2552, 30), ('ValueSizeConstraint', 2302, 27), ('ObjectIdentity', 2040, 24), ('Cache', 1785, 21), ('OrderedDict', 3807, 20), ('VarBind', 862, 20), ('SnmpAdminString', 1109, 17), ('ObjectGroup', 1190, 14), ('ValueRangeConstraint', 1124, 13), ('Integer32', 1023, 12), ('Null', 860, 10), ('SimpleSyntax', 852, 10), ('ObjectSyntax', 852, 10), ('ObjectType', 850, 10), ('ModuleIdentity', 765, 9), ('ModuleCompliance', 765, 9), ('MibScalarInstance', 367, 8), ('MibTableRow', 595, 7), ('MibTable', 595, 7), ('RowStatus', 343, 7), ('OctetString', 535, 6), ('NamedValues', 435, 5), ('SingleValueConstraint', 427, 5), ('DisplayString', 425, 5), ('StorageType', 341, 5), ('cell', 36738, 4), ('getset_descriptor', 7429, 4), ('ObjectIdentifier', 460, 4), ('SnmpEngineID', 340, 4), ('DirMibSource', 340, 4), ('TAddress', 172, 4), ('KeyChange', 340, 4), ('Integer', 328, 3), ('MibTree', 255, 3), ('NotificationType', 255, 3), ('PyPackageSearcher', 255, 3), ('TestAndIncr', 255, 3), ('ConstraintsUnion', 255, 3), ('HassJob', 2083, 2), ('TimeTicks', 177, 2), ('VarBindList', 90, 2), ('GetRequestPDU', 90, 2), ('Message', 2508, 2), ('Vacm', 170, 2), ('TimeInterval', 170, 2), ('TDomain', 170, 2), ('SnmpSecurityLevel', 170, 2), ('SnmpSecurityModel', 170, 2), ('SnmpMessageProcessingModel', 170, 2), ('NotificationGroup', 170, 2), ('FileReader', 170, 2), ('TimeStamp', 170, 2), ('SnmpEngineTime', 170, 2), ('SnmpTagList', 86, 2), ('SnmpTagValue', 86, 2), ('AutonomousType', 170, 2), ('IPv6Address', 80, 1), ('staticmethod', 1247, 1), ('Lexer', 87, 1), ('LRParser', 86, 1), ('Debouncer', 89, 1), ('IpAddress', 89, 1), ('PDUs', 88, 1), ('ScopedPDU', 86, 1), ('BrotherDataUpdateCoordinator', 85, 1), ('Brother', 85, 1), ('SnmpEngine', 85, 1), ('MetaObserver', 85, 1), ('MsgAndPduDispatcher', 85, 1), ('MibViewController', 85, 1), ('SnmpV1MessageProcessingModel', 85, 1), ('SnmpV2cMessageProcessingModel', 85, 1), ('SnmpV3MessageProcessingModel', 85, 1), ('SnmpV1SecurityModel', 85, 1), ('SnmpV2cSecurityModel', 85, 1), ('SnmpUSMSecurityModel', 85, 1), ('MibInstrumController', 85, 1), ('MibBuilder', 85, 1), ('SNMPv3Message', 85, 1), ('UsmSecurityParameters', 85, 1), ('UdpTransportAddress', 85, 1), ('Unsigned32', 85, 1), ('MibCompiler', 85, 1), ('SnmpUDPAddress', 85, 1)]
2021-02-04 12:58:48 CRITICAL (SyncWorker_3) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 12:59:18 CRITICAL (SyncWorker_10) [homeassistant.components.profiler] Memory Growth: [('set', 14395, 14), ('tuple', 84087, 9), ('cell', 36743, 5), ('function', 86638, 5), ('list_iterator', 6, 3), ('immutabledict', 29, 3), ('HassJob', 2085, 2), ('SQLiteExecutionContext', 2, 2), ('dict_items', 1, 1), ('TypeInvalid', 1, 1), ('traceback', 4, 1), ('tuple_iterator', 3, 1), ('chain', 1, 1), ('deque', 698, 1), ('_ConnectionFairy', 1, 1), ('Connection', 3, 1), ('ConnectionEventsDispatch', 3, 1), ('JoinedConnectionEventsDispatch', 1, 1), ('RootTransaction', 1, 1), ('groupby', 1, 1), ('_grouper', 1, 1), ('ResultProxy', 1, 1), ('cycle', 11, 1)]
2021-02-04 12:59:48 CRITICAL (SyncWorker_8) [homeassistant.components.profiler] Memory Growth: [('Message', 2509, 1)]
2021-02-04 13:00:18 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: [('dict', 315503, 2442), ('list', 227024, 2077), ('LRItem', 86774, 1009), ('Production', 28724, 334), ('function', 86824, 186), ('method', 18982, 137), ('tuple', 84204, 117), ('OidOrderedDict', 12212, 115), ('MibIdentifier', 5848, 68), ('set', 14458, 63), ('MibScalar', 5160, 60), ('type', 18395, 49), ('MibTableColumn', 3784, 44), ('ConstraintsIntersection', 3739, 43), ('Counter32', 3442, 40), ('ObjectName', 2582, 30), ('OrderedDict', 3834, 27), ('ValueSizeConstraint', 2329, 27), ('ObjectIdentity', 2064, 24), ('Cache', 1806, 21), ('weakref', 26824, 16), ('ObjectGroup', 1204, 14), ('ValueRangeConstraint', 1137, 13), ('Integer32', 1035, 12), ('Null', 870, 10), ('SimpleSyntax', 862, 10), ('ObjectSyntax', 862, 10), ('ObjectType', 860, 10), ('SnmpAdminString', 1118, 9), ('ModuleIdentity', 774, 9), ('ModuleCompliance', 774, 9), ('MibTableRow', 602, 7), ('MibTable', 602, 7), ('OctetString', 541, 6), ('NamedValues', 440, 5), ('SingleValueConstraint', 432, 5), ('DisplayString', 430, 5), ('Message', 2513, 4), ('getset_descriptor', 7433, 4), ('ObjectIdentifier', 464, 4), ('SnmpEngineID', 344, 4), ('DirMibSource', 344, 4), ('KeyChange', 344, 4), ('Integer', 331, 3), ('MibTree', 258, 3), ('NotificationType', 258, 3), ('PyPackageSearcher', 258, 3), ('TestAndIncr', 258, 3), ('StorageType', 344, 3), ('ConstraintsUnion', 258, 3), ('HassJob', 2087, 2), ('TimeTicks', 179, 2), ('Vacm', 172, 2), ('TimeInterval', 172, 2), ('TDomain', 172, 2), ('SnmpSecurityLevel', 172, 2), ('SnmpSecurityModel', 172, 2), ('SnmpMessageProcessingModel', 172, 2), ('NotificationGroup', 172, 2), ('FileReader', 172, 2), ('TimeStamp', 172, 2), ('SnmpEngineTime', 172, 2), ('AutonomousType', 172, 2), ('staticmethod', 1248, 1), ('Lexer', 88, 1), ('LRParser', 87, 1), ('Debouncer', 90, 1), ('IpAddress', 90, 1), ('PDUs', 89, 1), ('ScopedPDU', 87, 1), ('BrotherDataUpdateCoordinator', 86, 1), ('Brother', 86, 1), ('SnmpEngine', 86, 1), ('MetaObserver', 86, 1), ('MsgAndPduDispatcher', 86, 1), ('MibViewController', 86, 1), ('SnmpV1MessageProcessingModel', 86, 1), ('SnmpV2cMessageProcessingModel', 86, 1), ('SnmpV3MessageProcessingModel', 86, 1), ('SnmpV1SecurityModel', 86, 1), ('SnmpV2cSecurityModel', 86, 1), ('SnmpUSMSecurityModel', 86, 1), ('MibInstrumController', 86, 1), ('MibBuilder', 86, 1), ('SNMPv3Message', 86, 1), ('UsmSecurityParameters', 86, 1), ('UdpTransportAddress', 86, 1), ('Unsigned32', 86, 1), ('MibCompiler', 86, 1), ('SnmpUDPAddress', 86, 1), ('PySnmpCodeGen', 86, 1), ('SymtableCodeGen', 86, 1), ('PyFileWriter', 86, 1), ('StubSearcher', 86, 1), ('RowStatus', 344, 1), ('RowPointer', 86, 1), ('SmiParser', 86, 1), ('SmiLexer', 86, 1)]
2021-02-04 13:00:48 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: [('weakref', 26834, 10), ('method', 18991, 9), ('set', 14467, 9), ('_ModuleLockManager', 3, 3), ('_ModuleLock', 3, 3), ('Segment', 4, 1), ('dict_valueiterator', 1, 1), ('BytesIO', 5, 1), ('OutputContainer', 3, 1), ('StreamContainer', 4, 1), ('_ImportLockContext', 1, 1)]
2021-02-04 13:01:18 CRITICAL (SyncWorker_15) [homeassistant.components.profiler] Memory Growth: [('tuple', 84254, 50), ('dict', 315544, 41), ('list', 227041, 17), ('set', 14480, 13), ('weakref', 26846, 12), ('method', 19001, 10), ('function', 86826, 2), ('TimerHandle', 121, 1)]
2021-02-04 13:01:48 CRITICAL (SyncWorker_10) [homeassistant.components.profiler] Memory Growth: [('dict', 318327, 2783), ('list', 229218, 2177), ('LRItem', 87783, 1009), ('Production', 29058, 334), ('method', 19189, 188), ('function', 87005, 179), ('tuple', 84428, 174), ('OidOrderedDict', 12381, 169), ('set', 14605, 125), ('MibIdentifier', 5916, 68), ('weakref', 26910, 64), ('MibScalar', 5220, 60), ('type', 18444, 49), ('MibTableColumn', 3828, 44), ('ConstraintsIntersection', 3782, 43), ('Counter32', 3482, 40), ('ObjectName', 2612, 30), ('ValueSizeConstraint', 2356, 27), ('ObjectIdentity', 2088, 24), ('Cache', 1827, 21), ('VarBind', 882, 20), ('SnmpAdminString', 1135, 17), ('OrderedDict', 3849, 15), ('ObjectGroup', 1218, 14), ('ValueRangeConstraint', 1150, 13), ('Integer32', 1047, 12), ('Null', 880, 10), ('SimpleSyntax', 872, 10), ('ObjectSyntax', 872, 10), ('ObjectType', 870, 10), ('ModuleIdentity', 783, 9), ('ModuleCompliance', 783, 9), ('MibScalarInstance', 375, 8), ('MibTableRow', 609, 7), ('MibTable', 609, 7), ('RowStatus', 351, 7), ('OctetString', 547, 6), ('NamedValues', 445, 5), ('SingleValueConstraint', 437, 5), ('DisplayString', 435, 5), ('StorageType', 349, 5), ('getset_descriptor', 7437, 4), ('ObjectIdentifier', 468, 4), ('SnmpEngineID', 348, 4), ('DirMibSource', 348, 4), ('TAddress', 176, 4), ('KeyChange', 348, 4), ('Integer', 334, 3), ('MibTree', 261, 3), ('NotificationType', 261, 3), ('PyPackageSearcher', 261, 3), ('TestAndIncr', 261, 3), ('ConstraintsUnion', 261, 3), ('HassJob', 2089, 2), ('TimeTicks', 181, 2), ('VarBindList', 92, 2), ('GetRequestPDU', 92, 2), ('Message', 2515, 2), ('Vacm', 174, 2), ('TimeInterval', 174, 2), ('TDomain', 174, 2), ('SnmpSecurityLevel', 174, 2), ('SnmpSecurityModel', 174, 2), ('SnmpMessageProcessingModel', 174, 2), ('NotificationGroup', 174, 2), ('FileReader', 174, 2), ('TimeStamp', 174, 2), ('SnmpEngineTime', 174, 2), ('SnmpTagList', 88, 2), ('SnmpTagValue', 88, 2), ('AutonomousType', 174, 2), ('TimerHandle', 122, 1), ('Cookies', 19, 1), ('CookieJar', 23, 1), ('XMLParser', 2, 1), ('_ResolverRegistry', 3, 1), ('ImportResolver', 1, 1), ('_ParserContext', 1, 1), ('_ErrorLog', 2, 1), ('_TempStore', 2, 1), ('staticmethod', 1249, 1), ('Lexer', 89, 1), ('LRParser', 88, 1), ('Debouncer', 91, 1), ('IpAddress', 91, 1), ('PDUs', 90, 1), ('ScopedPDU', 88, 1), ('BrotherDataUpdateCoordinator', 87, 1), ('Brother', 87, 1), ('SnmpEngine', 87, 1), ('MetaObserver', 87, 1), ('MsgAndPduDispatcher', 87, 1), ('MibViewController', 87, 1), ('SnmpV1MessageProcessingModel', 87, 1), ('SnmpV2cMessageProcessingModel', 87, 1), ('SnmpV3MessageProcessingModel', 87, 1), ('SnmpV1SecurityModel', 87, 1), ('SnmpV2cSecurityModel', 87, 1), ('SnmpUSMSecurityModel', 87, 1), ('MibInstrumController', 87, 1)]
2021-02-04 13:02:18 CRITICAL (SyncWorker_11) [homeassistant.components.profiler] Memory Growth: [('tuple', 84595, 167), ('set', 14660, 55), ('ProcessState', 19, 19), ('function', 87021, 16), ('Context', 743, 13), ('SaveUpdateState', 12, 12), ('TimerHandle', 133, 11), ('weakref', 26918, 8), ('method', 19194, 5), ('cell', 36748, 5), ('Lock', 184, 3), ('UPNPEntry', 25, 3), ('History', 5, 2), ('ProcessAll', 4, 2), ('HassJob', 2090, 1), ('Connection', 4, 1)]
2021-02-04 13:02:48 CRITICAL (SyncWorker_3) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 13:03:18 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 13:03:48 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: [('dict', 320789, 2462), ('list', 231315, 2097), ('LRItem', 88792, 1009), ('Production', 29392, 334), ('function', 87201, 180), ('method', 19327, 133), ('OidOrderedDict', 12496, 115), ('MibIdentifier', 5984, 68), ('MibScalar', 5280, 60), ('type', 18493, 49), ('MibTableColumn', 3872, 44), ('ConstraintsIntersection', 3825, 43), ('Counter32', 3522, 40), ('ObjectName', 2642, 30), ('ValueSizeConstraint', 2383, 27), ('ObjectIdentity', 2112, 24), ('Cache', 1848, 21), ('set', 14679, 19), ('OrderedDict', 3867, 18), ('tuple', 84610, 15), ('ObjectGroup', 1232, 14), ('ValueRangeConstraint', 1163, 13), ('Integer32', 1059, 12), ('Null', 890, 10), ('SimpleSyntax', 882, 10), ('ObjectSyntax', 882, 10), ('ObjectType', 880, 10), ('weakref', 26927, 9), ('SnmpAdminString', 1144, 9), ('ModuleIdentity', 792, 9), ('ModuleCompliance', 792, 9), ('MibTableRow', 616, 7), ('MibTable', 616, 7), ('OctetString', 553, 6), ('NamedValues', 450, 5), ('SingleValueConstraint', 442, 5), ('DisplayString', 440, 5), ('getset_descriptor', 7441, 4), ('ObjectIdentifier', 472, 4), ('SnmpEngineID', 352, 4), ('DirMibSource', 352, 4), ('KeyChange', 352, 4), ('HassJob', 2093, 3), ('Integer', 337, 3), ('MibTree', 264, 3), ('NotificationType', 264, 3), ('PyPackageSearcher', 264, 3), ('TestAndIncr', 264, 3), ('StorageType', 352, 3), ('ConstraintsUnion', 264, 3), ('Message', 2517, 2), ('TimeTicks', 183, 2), ('Vacm', 176, 2), ('TimeInterval', 176, 2), ('TDomain', 176, 2), ('SnmpSecurityLevel', 176, 2), ('SnmpSecurityModel', 176, 2), ('SnmpMessageProcessingModel', 176, 2), ('NotificationGroup', 176, 2), ('FileReader', 176, 2), ('TimeStamp', 176, 2), ('SnmpEngineTime', 176, 2), ('AutonomousType', 176, 2), ('staticmethod', 1250, 1), ('Lexer', 90, 1), ('LRParser', 89, 1), ('Debouncer', 92, 1), ('IpAddress', 92, 1), ('PDUs', 91, 1), ('ScopedPDU', 89, 1), ('BrotherDataUpdateCoordinator', 88, 1), ('Brother', 88, 1), ('SnmpEngine', 88, 1), ('MetaObserver', 88, 1), ('MsgAndPduDispatcher', 88, 1), ('MibViewController', 88, 1), ('SnmpV1MessageProcessingModel', 88, 1), ('SnmpV2cMessageProcessingModel', 88, 1), ('SnmpV3MessageProcessingModel', 88, 1), ('SnmpV1SecurityModel', 88, 1), ('SnmpV2cSecurityModel', 88, 1), ('SnmpUSMSecurityModel', 88, 1), ('MibInstrumController', 88, 1), ('MibBuilder', 88, 1), ('SNMPv3Message', 88, 1), ('UsmSecurityParameters', 88, 1), ('UdpTransportAddress', 88, 1), ('Unsigned32', 88, 1), ('MibCompiler', 88, 1), ('SnmpUDPAddress', 88, 1), ('PySnmpCodeGen', 88, 1), ('SymtableCodeGen', 88, 1), ('PyFileWriter', 88, 1), ('StubSearcher', 88, 1), ('RowStatus', 352, 1), ('RowPointer', 88, 1), ('SmiParser', 88, 1), ('SmiLexer', 88, 1)]
2021-02-04 13:04:18 CRITICAL (SyncWorker_13) [homeassistant.components.profiler] Memory Growth: [('dict', 320857, 68), ('tuple', 84633, 23), ('list', 231331, 16), ('method', 19338, 11), ('function', 87211, 10), ('weakref', 26935, 8), ('set', 14686, 7), ('cell', 36753, 5), ('OrderedDict', 3870, 3), ('async_generator_asend', 2, 2), ('Message', 2518, 1), ('async_generator', 3, 1), ('AsyncIteratorByteStream', 1, 1), ('ResponseByteStream', 1, 1), ('IdentityDecoder', 1, 1), ('ConnectionClosed', 1, 1), ('Lock', 185, 1)]
2021-02-04 13:04:48 CRITICAL (SyncWorker_5) [homeassistant.components.profiler] Memory Growth: [('set', 14714, 28), ('wrapper_descriptor', 3122, 4), ('method_descriptor', 3045, 3), ('Response', 3, 1), ('SplitResult', 28, 1), ('SimpleCookie', 9, 1), ('CIMultiDict', 14, 1), ('UrlMappingMatchInfo', 4, 1)]
2021-02-04 13:05:18 CRITICAL (SyncWorker_0) [homeassistant.components.profiler] Memory Growth: [('dict', 323639, 2782), ('list', 233528, 2197), ('LRItem', 89801, 1009), ('Production', 29726, 334), ('tuple', 84857, 224), ('method', 19533, 195), ('function', 87401, 190), ('OidOrderedDict', 12665, 169), ('set', 14806, 92), ('MibIdentifier', 6052, 68), ('weakref', 26998, 63), ('MibScalar', 5340, 60), ('type', 18542, 49), ('MibTableColumn', 3916, 44), ('ConstraintsIntersection', 3868, 43), ('Counter32', 3562, 40), ('ObjectName', 2672, 30), ('ValueSizeConstraint', 2410, 27), ('ObjectIdentity', 2136, 24), ('Cache', 1869, 21), ('VarBind', 902, 20), ('SnmpAdminString', 1161, 17), ('ObjectGroup', 1246, 14), ('ValueRangeConstraint', 1176, 13), ('Integer32', 1071, 12), ('cell', 36763, 10), ('Null', 900, 10), ('SimpleSyntax', 892, 10), ('ObjectSyntax', 892, 10), ('ObjectType', 890, 10), ('ModuleIdentity', 801, 9), ('ModuleCompliance', 801, 9), ('OrderedDict', 3878, 8), ('MibScalarInstance', 383, 8), ('MibTableRow', 623, 7), ('MibTable', 623, 7), ('RowStatus', 359, 7), ('OctetString', 559, 6), ('NamedValues', 455, 5), ('SingleValueConstraint', 447, 5), ('DisplayString', 445, 5), ('StorageType', 357, 5), ('HassJob', 2097, 4), ('getset_descriptor', 7445, 4), ('ObjectIdentifier', 476, 4), ('SnmpEngineID', 356, 4), ('DirMibSource', 356, 4), ('TAddress', 180, 4), ('KeyChange', 356, 4), ('Integer', 340, 3), ('MibTree', 267, 3), ('NotificationType', 267, 3), ('PyPackageSearcher', 267, 3), ('TestAndIncr', 267, 3), ('ConstraintsUnion', 267, 3), ('TimeTicks', 185, 2), ('VarBindList', 94, 2), ('GetRequestPDU', 94, 2), ('Vacm', 178, 2), ('TimeInterval', 178, 2), ('TDomain', 178, 2), ('SnmpSecurityLevel', 178, 2), ('SnmpSecurityModel', 178, 2), ('SnmpMessageProcessingModel', 178, 2), ('NotificationGroup', 178, 2), ('FileReader', 178, 2), ('TimeStamp', 178, 2), ('SnmpEngineTime', 178, 2), ('SnmpTagList', 90, 2), ('SnmpTagValue', 90, 2), ('AutonomousType', 178, 2), ('CaseInsensitiveDict', 5, 1), ('staticmethod', 1251, 1), ('Lexer', 91, 1), ('LRParser', 90, 1), ('Debouncer', 93, 1), ('IpAddress', 93, 1), ('PDUs', 92, 1), ('ScopedPDU', 90, 1), ('Message', 2519, 1), ('BrotherDataUpdateCoordinator', 89, 1), ('Brother', 89, 1), ('SnmpEngine', 89, 1), ('MetaObserver', 89, 1), ('MsgAndPduDispatcher', 89, 1), ('MibViewController', 89, 1), ('SnmpV1MessageProcessingModel', 89, 1), ('SnmpV2cMessageProcessingModel', 89, 1), ('SnmpV3MessageProcessingModel', 89, 1), ('SnmpV1SecurityModel', 89, 1), ('SnmpV2cSecurityModel', 89, 1), ('SnmpUSMSecurityModel', 89, 1), ('MibInstrumController', 89, 1), ('MibBuilder', 89, 1), ('SNMPv3Message', 89, 1), ('UsmSecurityParameters', 89, 1), ('UdpTransportAddress', 89, 1), ('Unsigned32', 89, 1), ('MibCompiler', 89, 1), ('SnmpUDPAddress', 89, 1)]
2021-02-04 13:05:48 CRITICAL (SyncWorker_3) [homeassistant.components.profiler] Memory Growth: [('Context', 806, 63), ('method', 19577, 44), ('deque', 737, 39), ('tuple', 84890, 33), ('TimerHandle', 165, 32), ('weakref', 27025, 27), ('list', 233544, 16), ('_SelectorSocketTransport', 21, 14), ('SelectorKey', 27, 14), ('ResponseHandler', 17, 14), ('HttpResponseParser', 16, 14), ('StreamReader', 17, 14), ('SSLProtocol', 15, 14), ('_SSLProtocolTransport', 15, 14), ('_SSLPipe', 15, 14), ('TimerContext', 15, 14), ('SSLObject', 15, 14), ('TransportSocket', 22, 13), ('KeyedRef', 121, 13), ('CIMultiDict', 27, 13), ('socket', 52, 10), ('FutureIter', 30, 9), ('TaskWakeupMethWrapper', 31, 9), ('coroutine', 105, 8), ('Future', 39, 7), ('OrderedDict', 3885, 7), ('Task', 32, 5), ('Message', 2521, 2), ('frame', 154, 1), ('Lock', 186, 1), ('QueueManager', 3, 1)]
2021-02-04 13:06:18 CRITICAL (SyncWorker_6) [homeassistant.components.profiler] Memory Growth: [('function', 87402, 1), ('LP_ifaddrs', 42, 1), ('ifaddrs', 41, 1), ('Adapter', 17, 1)]
2021-02-04 13:06:48 CRITICAL (SyncWorker_0) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 13:07:18 CRITICAL (SyncWorker_7) [homeassistant.components.profiler] Memory Growth: [('dict', 326191, 2552), ('list', 235617, 2073), ('LRItem', 90810, 1009), ('Production', 30060, 334), ('function', 87597, 195), ('tuple', 85053, 163), ('method', 19695, 118), ('OidOrderedDict', 12780, 115), ('set', 14906, 100), ('MibIdentifier', 6120, 68), ('MibScalar', 5400, 60), ('type', 18591, 49), ('MibTableColumn', 3960, 44), ('ConstraintsIntersection', 3911, 43), ('Counter32', 3602, 40), ('ObjectName', 2702, 30), ('ValueSizeConstraint', 2437, 27), ('ObjectIdentity', 2160, 24), ('OrderedDict', 3906, 21), ('Cache', 1890, 21), ('weakref', 27042, 17), ('ObjectGroup', 1260, 14), ('ValueRangeConstraint', 1189, 13), ('Integer32', 1083, 12), ('Null', 910, 10), ('SimpleSyntax', 902, 10), ('ObjectSyntax', 902, 10), ('ObjectType', 900, 10), ('SnmpAdminString', 1170, 9), ('ModuleIdentity', 810, 9), ('ModuleCompliance', 810, 9), ('cell', 36771, 8), ('MibTableRow', 630, 7), ('MibTable', 630, 7), ('OctetString', 565, 6), ('NamedValues', 460, 5), ('SingleValueConstraint', 452, 5), ('DisplayString', 450, 5), ('HassJob', 2101, 4), ('getset_descriptor', 7449, 4), ('ObjectIdentifier', 480, 4), ('SnmpEngineID', 360, 4), ('DirMibSource', 360, 4), ('KeyChange', 360, 4), ('Integer', 343, 3), ('MibTree', 270, 3), ('NotificationType', 270, 3), ('PyPackageSearcher', 270, 3), ('TestAndIncr', 270, 3), ('StorageType', 360, 3), ('ConstraintsUnion', 270, 3), ('DNSPointer', 24, 2), ('TimeTicks', 187, 2), ('Message', 2523, 2), ('Vacm', 180, 2), ('TimeInterval', 180, 2), ('TDomain', 180, 2), ('SnmpSecurityLevel', 180, 2), ('SnmpSecurityModel', 180, 2), ('SnmpMessageProcessingModel', 180, 2), ('NotificationGroup', 180, 2), ('FileReader', 180, 2), ('TimeStamp', 180, 2), ('SnmpEngineTime', 180, 2), ('AutonomousType', 180, 2), ('DNSAddress', 6, 1), ('URL', 31, 1), ('CIMultiDictProxy', 7, 1), ('RawRequestMessage', 7, 1), ('Request', 8, 1), ('StreamWriter', 6, 1), ('UrlMappingMatchInfo', 5, 1), ('Lock', 187, 1), ('dict_itemiterator', 1, 1), ('staticmethod', 1252, 1), ('Lexer', 92, 1), ('LRParser', 91, 1), ('hamt', 29, 1), ('hamt_bitmap_node', 29, 1), ('Debouncer', 94, 1), ('IpAddress', 94, 1), ('PDUs', 93, 1), ('ScopedPDU', 91, 1), ('BrotherDataUpdateCoordinator', 90, 1), ('Brother', 90, 1), ('SnmpEngine', 90, 1), ('MetaObserver', 90, 1), ('MsgAndPduDispatcher', 90, 1), ('MibViewController', 90, 1), ('SnmpV1MessageProcessingModel', 90, 1), ('SnmpV2cMessageProcessingModel', 90, 1), ('SnmpV3MessageProcessingModel', 90, 1), ('SnmpV1SecurityModel', 90, 1), ('SnmpV2cSecurityModel', 90, 1), ('SnmpUSMSecurityModel', 90, 1), ('MibInstrumController', 90, 1), ('MibBuilder', 90, 1), ('SNMPv3Message', 90, 1), ('UsmSecurityParameters', 90, 1), ('UdpTransportAddress', 90, 1)]
2021-02-04 13:07:48 CRITICAL (SyncWorker_12) [homeassistant.components.profiler] Memory Growth: []
2021-02-04 13:08:18 CRITICAL (SyncWorker_1) [homeassistant.components.profiler] Memory Growth: [('tuple', 85068, 15), ('list', 235626, 9), ('HttpRequestParser', 5, 1)]
2021-02-04 13:08:48 CRITICAL (SyncWorker_7) [homeassistant.components.profiler] Memory Growth: [('dict', 328917, 2726), ('list', 237797, 2171), ('LRItem', 91819, 1009), ('Production', 30394, 334), ('function', 87773, 176), ('method', 19867, 172), ('OidOrderedDict', 12949, 169), ('tuple', 85233, 165), ('set', 15015, 109), ('MibIdentifier', 6188, 68), ('MibScalar', 5460, 60), ('weakref', 27094, 52), ('type', 18640, 49), ('MibTableColumn', 4004, 44), ('ConstraintsIntersection', 3954, 43), ('Counter32', 3642, 40), ('ObjectName', 2732, 30), ('ValueSizeConstraint', 2464, 27), ('ObjectIdentity', 2184, 24), ('Cache', 1911, 21), ('VarBind', 922, 20), ('SnmpAdminString', 1187, 17), ('ObjectGroup', 1274, 14), ('ValueRangeConstraint', 1202, 13), ('Integer32', 1095, 12), ('Null', 920, 10), ('SimpleSyntax', 912, 10), ('ObjectSyntax', 912, 10), ('ObjectType', 910, 10), ('ModuleIdentity', 819, 9), ('ModuleCompliance', 819, 9), ('MibScalarInstance', 391, 8), ('MibTableRow', 637, 7), ('MibTable', 637, 7), ('RowStatus', 367, 7), ('OctetString', 571, 6), ('NamedValues', 465, 5), ('SingleValueConstraint', 457, 5), ('DisplayString', 455, 5), ('StorageType', 365, 5), ('getset_descriptor', 7453, 4), ('ObjectIdentifier', 484, 4), ('OrderedDict', 3910, 4), ('SnmpEngineID', 364, 4), ('DirMibSource', 364, 4), ('TAddress', 184, 4), ('KeyChange', 364, 4), ('Integer', 346, 3), ('MibTree', 273, 3), ('NotificationType', 273, 3), ('PyPackageSearcher', 273, 3), ('TestAndIncr', 273, 3), ('ConstraintsUnion', 273, 3), ('TimeTicks', 189, 2), ('VarBindList', 96, 2), ('GetRequestPDU', 96, 2), ('Message', 2525, 2), ('Vacm', 182, 2), ('TimeInterval', 182, 2), ('TDomain', 182, 2), ('SnmpSecurityLevel', 182, 2), ('SnmpSecurityModel', 182, 2), ('SnmpMessageProcessingModel', 182, 2), ('NotificationGroup', 182, 2), ('FileReader', 182, 2), ('TimeStamp', 182, 2), ('SnmpEngineTime', 182, 2), ('SnmpTagList', 92, 2), ('SnmpTagValue', 92, 2), ('AutonomousType', 182, 2), ('staticmethod', 1253, 1), ('Lexer', 93, 1), ('LRParser', 92, 1), ('Debouncer', 95, 1), ('IpAddress', 95, 1), ('PDUs', 94, 1), ('ScopedPDU', 92, 1), ('BrotherDataUpdateCoordinator', 91, 1), ('Brother', 91, 1), ('SnmpEngine', 91, 1), ('MetaObserver', 91, 1), ('MsgAndPduDispatcher', 91, 1), ('MibViewController', 91, 1), ('SnmpV1MessageProcessingModel', 91, 1), ('SnmpV2cMessageProcessingModel', 91, 1), ('SnmpV3MessageProcessingModel', 91, 1), ('SnmpV1SecurityModel', 91, 1), ('SnmpV2cSecurityModel', 91, 1), ('SnmpUSMSecurityModel', 91, 1), ('MibInstrumController', 91, 1), ('MibBuilder', 91, 1), ('SNMPv3Message', 91, 1), ('UsmSecurityParameters', 91, 1), ('UdpTransportAddress', 91, 1), ('Unsigned32', 91, 1), ('MibCompiler', 91, 1), ('SnmpUDPAddress', 91, 1), ('PySnmpCodeGen', 91, 1), ('SymtableCodeGen', 91, 1), ('PyFileWriter', 91, 1)]
McGiverGim commented 3 years ago

Only to confirm that going back to 2021.1.5 version fixes the issue:

image

Looking at the changes posted in the blog, the only integration listed that I use is the Logitech Harmony.

probot-home-assistant[bot] commented 3 years ago

core documentation core source (message by IssueLinks)

sarahmva commented 3 years ago

Same problem here: image

HA survives for about 4 days. It is only the homeassistant container eating memory. VM has 16 GB RAM, I added some more for 24 GB but eventually this will be eaten up as well.

Unfortunately, for me it did not restart automatically and I had to reset the VM.

Running on Hyper-V / Debian / Docker

McGiverGim commented 3 years ago

I've tested version 2021.2.1, the problem remains...

ChristianH21220 commented 3 years ago

Hi McGiverGim,

your Log show at one Point "Brother" - is the Browser Integration installed? This Integration caused at my setup this issue. After uninstall the Integration all is back to normal after a full reboot. It look a old issue is back.

McGiverGim commented 3 years ago

Yes, I have it installed. If this is true is the third time the Brother issue causes a leak. I will try to uninstall it later and upgrade again.

FrankElias commented 3 years ago

Same problem here, running on rpi4 8GB

image

configuration

Version | core-2021.2.1
-- | --
Installation Type | Home Assistant OS
Development | false
Supervisor | true
Docker | true
Virtual Environment | false
Python Version | 3.8.7
Operating System Family | Linux
Operating System Version | 5.4.79-v8
CPU Architecture | aarch64
Timezone | Europe/Paris

Host Operating System | Home Assistant OS 5.10
-- | --
Update Channel | stable
Supervisor Version | supervisor-2021.01.7
Docker Version | 19.03.13
Disk Total | 228.5 GB
Disk Used | 16.3 GB
Healthy | true
Supported | true
Board | rpi4-64
Supervisor API | ok
Version API | ok
Installed Add-ons | ESPHome (1.16.0), Check Home Assistant configuration (3.6.0), File editor (5.2.0), Glances (0.10.0), Bitwarden RS (0.7.0), Log Viewer (0.9.1), Mosquitto broker (5.1), InfluxDB (4.0.1), Grafana (6.1.0), Bookstack (0.8.1), Grocy (0.11.0), MariaDB (2.2.1), Nextcloud (0.7), Terminal & SSH (9.0.0), HDD Tools (0.46), motionEye (0.11.0), chrony (2.0.0), Node-RED (8.1.0)
McGiverGim commented 3 years ago

It seems the core, not the addons the culprit of the memory growing. We are very few with the problem so the most probable is some integration. Could you post the list of integrations do you have? I will do it tomorrow when I will be back into the computer.

sarahmva commented 3 years ago

I can second, 2021.2.1 has the same problem. (the drop was the update to 2021.2.1) image

Regarding integrations: Apple TV Air Visual Blizortung Certificate Expiry Covid 19 Fontawesome Icons GDACS HACS Home Assistant iOS HomeKit IPP Meteobridge Datalogger Meterorologisk institutt Mobile App MQTT N2Y0 Satellite Tracker NWS Alerts nwsradar (this needs to be uninstalled since no longer supported) ONVIF (8 Cameras) PLEX rainmachine ring Scheduler integration Shopping List Simple Icons Speedtest title Uniquiti Unifi Vera (2 x Vera) Old Z-Wave

Greeneye Monitor Asterisk (unfortunately also broken) Pentair Screenlogic InfluxDB Grafana Node Red

A few other things through HACS

HDHomeRun Weatheralerts fontawesome Monitor Docker BER Status VW We Connect Mail and Packages keymaster

There are a bunch of these which are either not working correctly or have low value, maybe time to clean up a little bit

McGiverGim commented 3 years ago

Seeing your integrations, I have this that coincide with you:

But I think they are too common, if something was wrong I suppose we will have a ton of reports.

FrankElias commented 3 years ago

if this helps: I have less integrations (see below) and managed to stop the growth.

This is how I stopped the memory growth: 1) started motionEye to put the platform a bit more to work 1) deleted the integration of UPnP/IGD: Freebox Server 2) deleted the integration of Brother Printer 3) Server restart (no restart of motionEye) ==> memory consumptions remains flat + low.

I have noticed before, that the integration of UPnP has thrown error messages every ~90secs. @McGiverGim : Maybe the memory increase is because of the error messages accumulating in an in-memory table? I had these errors before, but they did not do any bad on memory consumption...

@sarahmva : What do you find in Configuration / Logs / Load Full Home Assistant Log: Any errors /repeated warnings?

image

list of integrations (btw, is there a way to dump a list....?)

ESPHome
freebox
Local IP Address
Meteorologisk institutt
Mobile App
MQTT
Météo-France
Raspberry Pi Power Supply
Shelly
Somfy
McGiverGim commented 3 years ago

I've the UPNP and Brother integration too. I will check to remove them and report back.

I don't think the culprit can be the messages being stored in memory, it will need a lot of them to fill the memory, but who knows...

McGiverGim commented 3 years ago

I think we are getting to something... I have disabled the device (not removed the integration) of my Brother and UPNP integrations, and the memory is stable. @FrankElias and @ChristianH21220 pointed to this integrations, so thanks to both!

Now I will enable them one by one and restart, to see what is the result...

McGiverGim commented 3 years ago

I have observed that the Brother integration produces errors with the device disabled... so maybe it was simply that I had the printer on and not off (so not producing errors) while this latest test. I will check it too.

ChristianH21220 commented 3 years ago

Printer on (standby) work as well, the memory use not growing. Remove the brother Integration, work and you can turn the printer off. A other User reported in the HA Community that it even get stabel when the Integration is removed, then System booted and install the Integration again. See the threat: https://community.home-assistant.io/t/2021-2-1-continual-memory-increase-similar-to-back-in-oct-2020/277794

McGiverGim commented 3 years ago

Let's ping @bieniu

I faced this problem before and it was fixed, but it seems some update has broken it again...

bieniu commented 3 years ago

There was no change in brother integration in 2021.02.0. Last change was in 2020.12.0.

McGiverGim commented 3 years ago

@bieniu thanks for your answer

Yes, I looked at it first when the problem faced, and I discarded Brother for this reason and opened the issue as "unknown", but after some tests it seems some change in the core has broken Brother in some way.

Is not only this issue, you can go to the community link and you will see more people with the same problem.

Maybe it can't be fixed in the integration, if the problem is in the core, but maybe you can have more information or something.

bieniu commented 3 years ago

I'll try to investigate this but probably not until the weekend.

McGiverGim commented 3 years ago

Thanks! If we find something more before we will let you know.

sarahmva commented 3 years ago

I am not sure it is the Brother integration. I don't have that in my system and still see the memory issue.

I think the log entry issue might be something to look into instead. I have a frequent mqtt error (still need to figure out why)

image

The number just keeps growing every few seconds.

bieniu commented 3 years ago

I can't reproduce memory leak in the brother integration (the HA starts when the device is offline so exactly as you describe it). But I suspect the snmp engine from pysnmp library could be the cause. I'll prepare a test version of the integration that creates the snmp engine differently, maybe it will help.

bieniu commented 3 years ago

Please test this https://github.com/bieniu/ha-brother-test as a custom component.

McGiverGim commented 3 years ago

Thanks for try to fixing that!

I will test it at the end of day. I want to check again first to be sure that the problem exists and it is fixed with this change alone, and I need some time to be sure that the memory leak is here or not after each reboot.

I don't know if other can check it now.

McGiverGim commented 3 years ago

@bieniu it seems the issue is fixed with you code :)

I can confirm that:

So I think you can push the PR. Thanks for this fast fix!!!!

bieniu commented 3 years ago

@McGiverGim thanks for testing. Now I have to figure how to add this change to 2021.2.x because dev branch uses a never version of the brother integration.

leranp commented 3 years ago

Same here, with raspberry pi 3b+ and HA core docker It is growing, but there is also problem that when the memory is low HA restart

McGiverGim commented 3 years ago

For all of you that use the Brother integration:

If you don't use the Brother integration:

McGiverGim commented 3 years ago

Integration Brother fixed in version 2021.2.3.

github-actions[bot] commented 3 years ago

There hasn't been any activity on this issue recently. Due to the high number of incoming GitHub notifications, we have to clean some of the old issues, as many of them have already been resolved with the latest updates. Please make sure to update to the latest Home Assistant version and check if that solves the issue. Let us know if that works for you by adding a comment 👍 This issue has now been marked as stale and will be closed if no further activity occurs. Thank you for your contributions.