microsoft / qsharp

Azure Quantum Development Kit, including the Q# programming language, resource estimator, and Quantum Katas
https://microsoft.github.io/qsharp/
MIT License
367 stars 73 forks source link

Adding Python QIR Integration tests #1633

Closed idavis closed 1 week ago

github-actions[bot] commented 2 weeks ago

Benchmark for bbb575e

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 332.3±2.17µs | **327.0±1.42µs** | **-1.59%** | | Array literal evaluation | **171.5±0.86µs** | 189.2±0.74µs | **+10.32%** | | Array update evaluation | 413.3±4.47µs | **408.3±1.94µs** | **-1.21%** | | Core + Standard library compilation | 19.6±0.72ms | 19.6±0.74ms | 0.00% | | Deutsch-Jozsa evaluation | 5.1±0.04ms | 5.1±0.05ms | 0.00% | | Large file parity evaluation | 34.0±0.09ms | 34.0±0.32ms | 0.00% | | Large input file compilation | 13.0±0.47ms | 12.9±0.34ms | -0.77% | | Large input file compilation (interpreter) | 50.7±1.75ms | 49.9±1.39ms | -1.58% | | Large nested iteration | 32.7±0.13ms | 32.6±0.73ms | -0.31% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1593.2±107.17µs | 1594.8±89.08µs | +0.10% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | **7.9±0.11ms** | 8.1±0.14ms | **+2.53%** | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1450.9±79.55µs | 1446.5±45.77µs | -0.30% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.5±0.30ms | 28.4±0.30ms | -0.35% | | Teleport evaluation | 88.8±3.44µs | 88.6±3.53µs | -0.23% |
github-actions[bot] commented 2 weeks ago

Benchmark for 6ed5651

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 329.8±1.24µs | 329.8±0.93µs | 0.00% | | Array literal evaluation | 192.7±2.17µs | **172.1±3.11µs** | **-10.69%** | | Array update evaluation | **406.1±1.09µs** | 411.2±1.75µs | **+1.26%** | | Core + Standard library compilation | 21.0±0.93ms | **18.7±0.46ms** | **-10.95%** | | Deutsch-Jozsa evaluation | 5.1±0.05ms | 5.1±0.04ms | 0.00% | | Large file parity evaluation | **34.1±0.15ms** | 34.4±0.17ms | **+0.88%** | | Large input file compilation | 13.0±0.46ms | **12.3±0.17ms** | **-5.38%** | | Large input file compilation (interpreter) | 51.2±1.95ms | **47.9±1.81ms** | **-6.45%** | | Large nested iteration | **32.2±0.14ms** | 32.8±0.29ms | **+1.86%** | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1568.4±67.95µs | 1568.5±48.78µs | +0.01% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.0±0.16ms | **7.8±0.09ms** | **-2.50%** | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1425.5±47.20µs | 1427.5±36.19µs | +0.14% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.2±0.23ms | 28.3±0.74ms | +0.35% | | Teleport evaluation | 92.3±3.54µs | 89.5±3.89µs | -3.03% |
github-actions[bot] commented 2 weeks ago

Benchmark for 4738ae5

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | **324.2±1.48µs** | 330.2±6.96µs | **+1.85%** | | Array literal evaluation | **192.1±0.76µs** | 196.1±4.34µs | **+2.08%** | | Array update evaluation | **405.8±5.38µs** | 417.5±54.40µs | **+2.88%** | | Core + Standard library compilation | 22.1±0.70ms | 21.5±1.10ms | -2.71% | | Deutsch-Jozsa evaluation | 5.1±0.06ms | 5.1±0.05ms | 0.00% | | Large file parity evaluation | 33.9±0.08ms | **33.8±0.10ms** | **-0.29%** | | Large input file compilation | 13.4±0.64ms | **12.5±0.27ms** | **-6.72%** | | Large input file compilation (interpreter) | 51.7±2.32ms | 51.1±5.30ms | -1.16% | | Large nested iteration | 32.1±0.29ms | 32.2±0.22ms | +0.31% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1610.5±132.73µs | 1590.7±115.12µs | -1.23% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.2±0.16ms | 8.2±0.16ms | 0.00% | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1457.9±123.64µs | 1442.8±42.19µs | -1.04% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.9±0.36ms | **28.5±0.35ms** | **-1.38%** | | Teleport evaluation | 88.1±3.64µs | 89.6±7.53µs | +1.70% |
github-actions[bot] commented 2 weeks ago

Benchmark for 20a3d65

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | **327.0±2.25µs** | 343.4±4.40µs | **+5.02%** | | Array literal evaluation | 191.8±0.74µs | 192.1±0.75µs | +0.16% | | Array update evaluation | **407.2±4.72µs** | 422.8±17.45µs | **+3.83%** | | Core + Standard library compilation | 20.4±0.41ms | **19.9±0.18ms** | **-2.45%** | | Deutsch-Jozsa evaluation | 5.1±0.05ms | 5.1±0.05ms | 0.00% | | Large file parity evaluation | 33.9±0.13ms | 34.0±0.34ms | +0.29% | | Large input file compilation | **12.4±0.06ms** | 12.5±0.18ms | **+0.81%** | | Large input file compilation (interpreter) | 48.6±1.44ms | **47.7±0.81ms** | **-1.85%** | | Large nested iteration | **32.1±0.22ms** | 33.6±0.20ms | **+4.67%** | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1558.2±28.90µs | 1567.1±35.67µs | +0.57% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.0±0.18ms | **7.8±0.09ms** | **-2.50%** | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1427.4±49.03µs | 1428.4±35.11µs | +0.07% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.4±0.26ms | **28.0±0.60ms** | **-1.41%** | | Teleport evaluation | 88.1±4.38µs | 88.2±3.86µs | +0.11% |
github-actions[bot] commented 2 weeks ago

Benchmark for 20a3d65

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | **329.0±3.38µs** | 334.2±9.12µs | **+1.58%** | | Array literal evaluation | 192.2±0.91µs | **179.3±21.93µs** | **-6.71%** | | Array update evaluation | 404.2±3.74µs | 406.9±5.39µs | +0.67% | | Core + Standard library compilation | **20.7±0.99ms** | 22.2±0.97ms | **+7.25%** | | Deutsch-Jozsa evaluation | **5.0±0.06ms** | 5.1±0.09ms | **+2.00%** | | Large file parity evaluation | 33.9±0.11ms | 34.0±0.76ms | +0.29% | | Large input file compilation | 13.1±0.59ms | 13.6±0.50ms | +3.82% | | Large input file compilation (interpreter) | **49.8±1.82ms** | 51.9±1.17ms | **+4.22%** | | Large nested iteration | **32.1±0.27ms** | 32.7±0.50ms | **+1.87%** | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1561.3±43.36µs | 1591.5±102.00µs | +1.93% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 7.8±0.13ms | 7.9±0.16ms | +1.28% | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1424.8±38.99µs | 1451.1±99.91µs | +1.85% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | **28.2±0.31ms** | 28.6±0.36ms | **+1.42%** | | Teleport evaluation | 87.7±4.10µs | 87.2±3.35µs | -0.57% |
github-actions[bot] commented 2 weeks ago

Benchmark for 349f5b6

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 329.4±1.82µs | 330.6±2.50µs | +0.36% | | Array literal evaluation | 174.3±0.99µs | 174.8±2.65µs | +0.29% | | Array update evaluation | 407.2±1.50µs | 407.7±2.01µs | +0.12% | | Core + Standard library compilation | **20.2±0.39ms** | 20.6±0.63ms | **+1.98%** | | Deutsch-Jozsa evaluation | 5.1±0.05ms | 5.1±0.04ms | 0.00% | | Large file parity evaluation | **33.9±0.09ms** | 34.0±0.37ms | **+0.29%** | | Large input file compilation | 12.6±0.42ms | 12.5±0.20ms | -0.79% | | Large input file compilation (interpreter) | 48.8±1.11ms | 49.4±1.36ms | +1.23% | | Large nested iteration | 32.5±0.13ms | 32.4±0.21ms | -0.31% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1560.5±40.57µs | 1567.3±58.75µs | +0.44% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 7.8±0.09ms | 7.8±0.10ms | 0.00% | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1430.5±85.43µs | 1433.3±60.50µs | +0.20% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | **28.0±0.15ms** | 28.2±0.30ms | **+0.71%** | | Teleport evaluation | 87.6±3.53µs | 88.5±3.81µs | +1.03% |
github-actions[bot] commented 2 weeks ago

Benchmark for 460f5ea

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 335.6±8.32µs | **330.6±4.39µs** | **-1.49%** | | Array literal evaluation | **174.3±0.96µs** | 175.4±9.01µs | **+0.63%** | | Array update evaluation | 406.5±4.28µs | 406.5±3.11µs | 0.00% | | Core + Standard library compilation | 22.9±0.75ms | 23.0±0.70ms | +0.44% | | Deutsch-Jozsa evaluation | 5.1±0.04ms | 5.1±0.04ms | 0.00% | | Large file parity evaluation | 34.0±0.09ms | 34.0±0.35ms | 0.00% | | Large input file compilation | **13.7±0.38ms** | 15.1±0.82ms | **+10.22%** | | Large input file compilation (interpreter) | 53.1±1.66ms | 54.3±1.41ms | +2.26% | | Large nested iteration | 32.7±0.42ms | 32.4±0.46ms | -0.92% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1604.1±132.53µs | 1599.7±104.33µs | -0.27% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.3±0.45ms | 8.2±0.28ms | -1.20% | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1453.2±77.52µs | 1483.1±160.70µs | +2.06% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | **28.9±0.49ms** | 29.4±0.85ms | **+1.73%** | | Teleport evaluation | 88.1±3.74µs | 88.4±3.98µs | +0.34% |
github-actions[bot] commented 1 week ago

Benchmark for 4e6ce2f

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 331.1±2.12µs | 330.9±5.88µs | -0.06% | | Array literal evaluation | 178.3±5.58µs | **175.1±1.65µs** | **-1.79%** | | Array update evaluation | 408.5±0.99µs | **405.9±1.99µs** | **-0.64%** | | Core + Standard library compilation | 22.6±0.62ms | 23.0±0.90ms | +1.77% | | Deutsch-Jozsa evaluation | 5.1±0.08ms | 5.1±0.05ms | 0.00% | | Large file parity evaluation | **33.9±0.07ms** | 34.1±0.19ms | **+0.59%** | | Large input file compilation | **13.1±0.26ms** | 14.4±0.43ms | **+9.92%** | | Large input file compilation (interpreter) | **52.4±1.34ms** | 54.9±1.63ms | **+4.77%** | | Large nested iteration | 33.1±1.30ms | 32.7±0.70ms | -1.21% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1603.2±104.42µs | 1595.0±76.60µs | -0.51% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.3±0.20ms | **8.0±0.14ms** | **-3.61%** | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1467.6±136.27µs | 1456.2±94.68µs | -0.78% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 29.0±0.22ms | 29.0±0.39ms | 0.00% | | Teleport evaluation | 88.0±3.91µs | 87.8±3.55µs | -0.23% |
github-actions[bot] commented 1 week ago

Benchmark for 3fb62c1

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | **324.2±1.42µs** | 330.7±4.35µs | **+2.00%** | | Array literal evaluation | 191.9±0.80µs | **179.3±9.58µs** | **-6.57%** | | Array update evaluation | **402.5±2.42µs** | 406.6±3.69µs | **+1.02%** | | Core + Standard library compilation | 20.5±0.42ms | **20.0±0.19ms** | **-2.44%** | | Deutsch-Jozsa evaluation | 5.1±0.06ms | 5.1±0.06ms | 0.00% | | Large file parity evaluation | **33.8±0.08ms** | 34.0±0.72ms | **+0.59%** | | Large input file compilation | 12.5±0.16ms | 12.4±0.16ms | -0.80% | | Large input file compilation (interpreter) | 49.2±1.23ms | 49.1±1.85ms | -0.20% | | Large nested iteration | **31.9±0.15ms** | 32.4±0.25ms | **+1.57%** | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1564.7±33.39µs | 1554.7±34.18µs | -0.64% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 7.9±0.13ms | 7.8±0.13ms | -1.27% | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1420.0±61.41µs | 1415.4±31.15µs | -0.32% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.3±0.24ms | **28.0±0.14ms** | **-1.06%** | | Teleport evaluation | 88.1±3.80µs | 87.6±3.38µs | -0.57% |
github-actions[bot] commented 1 week ago

Benchmark for 7fd349a

Click to view benchmark | Test | Base | PR | % | |------|--------------|------------------|---| | Array append evaluation | 331.3±5.01µs | 331.4±6.63µs | +0.03% | | Array literal evaluation | **174.8±1.29µs** | 192.6±0.81µs | **+10.18%** | | Array update evaluation | 407.7±4.15µs | 409.5±10.08µs | +0.44% | | Core + Standard library compilation | 21.6±0.95ms | **20.6±0.28ms** | **-4.63%** | | Deutsch-Jozsa evaluation | 5.0±0.05ms | 5.0±0.04ms | 0.00% | | Large file parity evaluation | 33.9±0.41ms | 34.0±0.15ms | +0.29% | | Large input file compilation | 12.7±0.21ms | 12.6±0.14ms | -0.79% | | Large input file compilation (interpreter) | 51.2±1.69ms | **49.8±1.21ms** | **-2.73%** | | Large nested iteration | 32.3±0.20ms | 32.2±0.15ms | -0.31% | | Perform Runtime Capabilities Analysis (RCA) on Deutsch-Jozsa sample | 1570.3±52.82µs | 1558.7±38.82µs | -0.74% | | Perform Runtime Capabilities Analysis (RCA) on large file sample | 8.0±0.13ms | **7.9±0.09ms** | **-1.25%** | | Perform Runtime Capabilities Analysis (RCA) on teleport sample | 1432.4±56.27µs | 1420.7±37.46µs | -0.82% | | Perform Runtime Capabilities Analysis (RCA) on the core and std libraries | 28.3±0.20ms | 28.3±0.25ms | 0.00% | | Teleport evaluation | 87.5±3.67µs | 87.5±4.53µs | 0.00% |