CompilerGym v0.2.5

[ChrisCummins]

Release 0.2.5 (2022-11-01)

CompilerGym v0.2.5 adds a new LLVM dataset, two new observation spaces, and includes numerous updates and bug fixes.

Summary of Changes

• [llvm] Added two new observation spaces, LexedIr and LexedIrTuple, providing access to a sequence of IR tokens (#742, thanks @fivosts!).
• [llvm] Added the "Jotaibench" benchmark suite, providing 18,761 new executable C programs extracted from handwritten code on GitHub (#705, thanks @canesche!).
• Added support for Python 3.10.
• [llvm] Fixed a bug with non-terminating subprocesses (#741, thanks @thecoblack!).
• [llvm] Fixed a bug where the incorrect number of runtimes were reported by reset() (#761), and an incorrect number of warm up runs were being performed (#717, thanks @lqwk!).
• [llvm] New leaderboard submission using GATv2 and DD-PPO (#728, thanks @anthony0727!).
• Added the ability to set timeout on each of the individual environment operations (#716, thanks @ricardoprins!).
• Added support for loading URLs in CompilerEnvStateReader.read_paths() (#692, thanks @thecoblack!).
• Simplified Makefile rules: renamed install-test to test and deprecated bazel test rules.
• Fixed a bug where the TimeLimit wrapper would interfere with benchmark iterator wrappers (#739, thanks @nluu175!).
• [ci] Added CI test coverage of example services (#695, #642, #699, thanks @mostafaelhoushi!).
• [ci] Updated Github actions to use Node v16.
• Reduced verbosity and wall time of CMake builds.
• Updates and fixes dependent package conflicts (fixes #771, #768).

Credits

A huge thank you to all code contributors!

• @anthony0727
• @canesche made their first contribution in #705
• @fivosts made their first contribution in #742
• @jaopaulolc made their first contribution in #738
• @lqwk made their first contribution in #717
• @mostafaelhoushi
• @nluu175 made their first contribution in #739
• @ricardoprins made their first contribution in #716
• @ryanrussell made their first contribution in #755
• @sahirgomez1
• @thecoblack
• @youweiliang made their first contribution in #751

Full Changelog: v0.2.4...v0.2.5

[codecov-commenter]

Codecov Report

Merging #767 (fd26fd5) into stable (ed9107d) will increase coverage by 0.08%. The diff coverage is 72.43%.

Additional details and impacted files

[](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) ```diff @@ Coverage Diff @@ ## stable #767 +/- ## ========================================== + Coverage 88.61% 88.70% +0.08% ========================================== Files 131 131 Lines 7926 7995 +69 ========================================== + Hits 7024 7092 +68 - Misses 902 903 +1 ``` | [Impacted Files](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) | Coverage Δ | | |---|---|---| | [compiler\_gym/bin/random\_replay.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2Jpbi9yYW5kb21fcmVwbGF5LnB5) | `0.00% <ø> (ø)` | | | [compiler\_gym/datasets/dataset.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2RhdGFzZXRzL2RhdGFzZXQucHk=) | `84.44% <ø> (-0.56%)` | :arrow_down: | | [compiler\_gym/datasets/uri.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2RhdGFzZXRzL3VyaS5weQ==) | `100.00% <ø> (+6.81%)` | :arrow_up: | | [compiler\_gym/envs/compiler\_env.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2VudnMvY29tcGlsZXJfZW52LnB5) | `75.15% <ø> (-0.30%)` | :arrow_down: | | [compiler\_gym/envs/gcc/gcc\_env.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2VudnMvZ2NjL2djY19lbnYucHk=) | `100.00% <ø> (ø)` | | | [compiler\_gym/envs/llvm/datasets/poj104.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2VudnMvbGx2bS9kYXRhc2V0cy9wb2oxMDQucHk=) | `76.81% <ø> (+34.91%)` | :arrow_up: | | [compiler\_gym/envs/llvm/llvm\_rewards.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL2VudnMvbGx2bS9sbHZtX3Jld2FyZHMucHk=) | `100.00% <ø> (ø)` | | | [compiler\_gym/service/connection.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL3NlcnZpY2UvY29ubmVjdGlvbi5weQ==) | `76.69% <ø> (-1.97%)` | :arrow_down: | | [compiler\_gym/spaces/reward.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL3NwYWNlcy9yZXdhcmQucHk=) | `78.84% <ø> (+5.16%)` | :arrow_up: | | [compiler\_gym/util/debug\_util.py](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch#diff-Y29tcGlsZXJfZ3ltL3V0aWwvZGVidWdfdXRpbC5weQ==) | `100.00% <ø> (ø)` | | | ... and [36 more](https://codecov.io/gh/facebookresearch/CompilerGym/pull/767/diff?src=pr&el=tree-more&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=facebookresearch) | |