Performance results for Reliable Collections (Dictionary, Queue and Concurrent Queue)

[MedAnd]

Provide a best practice Service Fabric .Net Core application for automated performance testing of Reliable Collections and publish results for each version of the Service Fabric & .Net Core run-times.

Publish results for:

• Reliable Dictionary, Reliable Queue, Reliable Concurrent Queue
• Heavy read and write workloads
• Varying message sizes such as 50KB, 100KB, 200KB, 500KB, 800K
• Different serializers
• Different communication stacks (Service Fabric Remoting V1/V2, WCF NetTcp, WebSocket, Kestrel, gRCP, HTTP/2)
• Enable Accelerated Networking
• Include correlation with CPU, memory, network/IO activity etc.
• Measure latency and throughput
• Document any specific performance best practices & tweaks affecting throughput & latency, memory consumption etc, such as ReplicatorConfig (BatchAcknowledgementInterval, MaxPrimaryReplicationQueueSize, MaxSecondaryReplicationQueueSize etc).
• Update existing Reliable Collections API documentation to clarify which APIs result in caching and which are non caching
• Consider using BenchmarkDotNet

Links:

• https://github.com/jessebenson/azure-performance
• https://github.com/vsaroopchand/ServiceFabric-Performance-Test

[masnider]

This makes sense except for the communication stack part.

[MedAnd]

@masnider - appreciate the feedback & agree the communication stack part should be it's own request.

[MedAnd]

@zuhairp / @masnider - hoping we can update the existing Reliable Collections API documentation to clarify which APIs are caching and which are non caching as per our discussions?

For example:

Enumeration: To make enumeration efficient, contents of the hahstable get added into a temporary sorted data structure until it is moved into the main sorted data structure post checkpoint. So it is O(log n).

Links

• https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-reliable-services-reliable-collections
• https://docs.microsoft.com/en-us/azure/service-fabric/service-fabric-reliable-services-reliable-collections-guidelines