Run upgrade_path sonic-mgmt test in warm mode from 202205 to 202305
Describe the results you received:
Depending on whether LAG is created on first ports (Ethernet0, Ethernet2) or last one it will have different restoration time: e.g:
Dec 20 18:01:42.785263 sonic NOTICE swss#orchagent: :- initPort: Initialized port Ethernet0
Dec 20 18:01:47.467496 sonic NOTICE swss#orchagent: :- initPort: Initialized port Ethernet126
It takes ~5 sec to init all 56 ports. Roughly 0.1 sec per port. The initPort() in orchagent does query many attributes and port capabilities which takes time to serialize/deserialize back and forth as well as does not scale as more features are added.
Description
Steps to reproduce the issue:
Describe the results you received:
Depending on whether LAG is created on first ports (Ethernet0, Ethernet2) or last one it will have different restoration time: e.g:
It takes ~5 sec to init all 56 ports. Roughly 0.1 sec per port. The
initPort()
in orchagent does query many attributes and port capabilities which takes time to serialize/deserialize back and forth as well as does not scale as more features are added.E.g: https://github.com/sonic-net/sonic-swss/blob/202305/orchagent/portsorch.cpp#L4959
We can optimize this by creating host interfaces as early as possible and query rest of the things later.
Describe the results you expected:
Stable under 90 sec with ~20 sec headroom.
Output of
show version
:Output of
show techsupport
:Additional information you deem important (e.g. issue happens only occasionally):
Also, there were other warm boot related issues reported: