Open victor-teles opened 7 months ago
Thank you Victor for taking the lead.
Here's some thoughts that could help you:
@ematipico
Thank you for the feedback! Your thoughts make sense to me, I'll update the task description
I don't know much about Biome's internal benchmarking structure but it could be useful to use https://codspeed.io which comments on PRs with any performance changes that have happened.
Yeah I plan to set it up in the next few weeks :)
Description
So that we can be more efficient when developing and modifying rules while ensuring that performance remains high. I would like to propose a new command-line that will individually benchmark each rule, following the current benchmark standards we already use.
The proposed command
and an alias
Test data
For test data, we'll reuse current
invalid.{ts,json,js,tsx,jsx}
test files from rules.Github PR comment action
As we've an comment action to run the benchmark for
bench_analyzer
,bench_cli
,bench_formatter
andbench_parser
We can also introduce a new comment action for rules:!bench_rule [rule_name]
Output
Rule performance result
bench/rule.ts
main
count