Performance benchmarking framework for Swift projection tooling

[kotlarmilos]

Overview

This issue outlines the development of a performance benchmarking framework for Swift projection tooling. The framework aims to measure performance metrics, compare them with Objective-C wrappers, and include telemetry data to tracking impact of changes.

Proposal

• Invocation latency: The time required for pinvoke method invocations with and without Objective-C wrappers.
• Size on disk (SOD): The disk space utilization by the generated bindings.
• Startup and execution time: The startup and execution time for e2e scenarios https://github.com/dotnet/runtime/issues/95636.

Additionally, the framework will integrate telemetry data to compare usage with tooling changes.

Tasks

The list of tasks:

• [ ] Framework architecture design (with the existing performance components?)
• [ ] Telemetry integration (within the SDK?) to gather usage data
• [ ] Performance benchmarking
  • [ ] Compare direct vs. ObjC wrapper performance benchmarks for pinvoke invocations
  • [ ] Evaluate performance metrics for e2e scenarios
  • [ ] Set up monitoring system