sabracrolleton / sabracrolleton.github.io

Notes on Common Lisp Libraries
MIT License
14 stars 5 forks source link

Comparison of Common Lisp Testing Frameworks: Tiers? #9

Open Hexstream opened 1 year ago

Hexstream commented 1 year ago

Hello!

So, I finally reached a breaking point and decided to just write my own unit testing framework. (I had been using Parachute.)

I just finished reading your great article as a starting point. Great stuff! I feel ready to start writing the best Common Lisp unit testing framework now. :)

I think the biggest change I would make to your article is separating the detailed library descriptions into "tiers" such as, for example, recommended, good and lacking. I think the alphabetical ordering doesn't really cut it in terms of usability.

(I am aware of the Quick Summary, but my proposed improvement is geared towards those who actually want to dig into the details, but not necessarily read the entire article (which is pretty long!), or not necessarily with the same level of attention.)

Hexstream commented 1 year ago

I updated my roadmap regarding this. :)

foretspaisibles commented 7 months ago

Hello @Hexstream how is writing a test framework going? If you mind have a look at Confidence which I am writing and tell me what you do not like and how to improve it, I would super happy to engage the conversation! https://github.com/melusina-org/cl-confidence/issues

You can see a mildly complex usage example at https://github.com/melusina-org/cid

Hexstream commented 7 months ago

Hello @Hexstream how is writing a test framework going?

Hello, thank you for inquiring!

I haven't yet created the repo, but I have fairly concrete ideas for it, I think I already have a pretty good idea of what it will look like.

In terms of my public roadmap, I wouldn't be surprised if I just barely had time to finish HexstreamSoft Sponsors 2.0 in 2024. I would say this is perhaps my second biggest project ever! (The biggest would be BahagonTools, which is no longer available.) Incidentally, this is also my second "actual" web app with actual server-side components. (The first one again being BahagonTools.)

I will also be working on several infrastructural upgrades in 2024. These are not mentioned on my public roadmap. Many of those upgrades will make it easier to implement HexstreamSoft Sponsors 2.0, or will otherwise make things easier for me. I also have at least one very high-impact secret project slated for release in 2024 or 2025.

If you mind have a look at Confidence which I am writing and tell me what you do not like and how to improve it, I would super happy to engage the conversation!

Thank you, I am very flattered by the offer!

Unfortunately, I am rather extremely overloaded at the moment, and more fundamentally, I deeply hate reading third-party code.

I can see that Confidence was mentioned as part of Sabra's great article, which I have read in full. I must say there is one single testing framework in there that impressed me in any way. All others seemingly fail at taking advantage of Common Lisp's most basic capabilities. I don't want to say more about this for now. :)

I am looking forward to releasing my great Common Lisp testing framework in 2025!

edit: On second thought, this would better have been asked and answered on my roadmap's repo... ¯\_(ツ)_/¯