kaitai-io / kaitai_struct

Kaitai Struct: declarative language to generate binary data parsers in C++ / C# / Go / Java / JavaScript / Lua / Nim / Perl / PHP / Python / Ruby
https://kaitai.io
4.04k stars 199 forks source link

CI: show off kaitai-struct-compiler unit tests #1057

Open GreyCat opened 1 year ago

GreyCat commented 1 year ago

KSC includes unit tests, which are sometimes known as translator-tests. These technically are ran during CI, but they known to be not 100% complete, and thus they don't break the build, but it's too hard to keep track of them at the moment.

It would be great to publish these results somewhere around https://ci.kaitai.io/ (maybe on a separate page?) and keep track of the progress.

generalmimon commented 1 year ago

Isn't this a duplicate of https://github.com/kaitai-io/kaitai_struct/issues/551?

Perhaps this issue is meant more generally, though - https://github.com/kaitai-io/kaitai_struct/issues/551 has specifically the expression tests in mind, which are part of the internal compiler test suite, but are not the only tests there.

GreyCat commented 1 year ago

Yes and no. #551 speaks of expression translator tests, which clearly form a test-language matrix. Some language's implementations might be broken sometimes, and that's what we want to track.

This one is more generic, showcasing the rest of the tests (probably excluding expression translator tests that will be on a separate page with language matrix layout), just something like more regular "test → status" layout.