smarr / are-we-fast-yet

Are We Fast Yet? Comparing Language Implementations with Objects, Closures, and Arrays
Other
334 stars 36 forks source link

Use asdf to get a "portable" setup for a large set of implementations #86

Open smarr opened 8 months ago

smarr commented 8 months ago

I am currently starting to use asdf to setup my own benchmarking infrastructure. This seems a comprehensive enough project to support a broad range of the language implementations we may want to compare.

@eregon any thoughts? It seems fine from what I have seen so far, but perhaps you know about rough edges?

eregon commented 8 months ago

asdf uses ruby-build for ruby and ruby-build is the best Ruby installer, so no concerns from my side. One thing is asdf like rbenv uses shims which means a small overhead when starting a process (but very likely doesn't matter for these benchmarks as we don't time the whole process) and might need to rehash manually every now and then.

I have read recently that rbenv can have a non-trivial cost on shell-startup, but I'm not sure if still the case and whether it affects asdf too. (doesn't matter for these benchmarks)

smarr commented 8 months ago

Ok, great, thanks.

At the moment, I have not really "installed" asdf, and actually just use it as a downloader with a consistent set of commands, so, even if we'd be interested in startup cost, I am using direct path to the executables.

eregon commented 8 months ago

Even better then!