[Enhancement] The KCL testing tool supports testing incorrect failure cases, such as schema check conditions using the runtime.catch function

[Peefy]

For exampla

• main.k

schema Name:
    count: int

    check:
        count > 10

• main_test.k

import runtime

test_name_schema_failed = lambda {
    assert "Schema check failed" in runtime.catch(lambda {Name{count: 10}}
}

[Wck-iipi]

@Peefy Can I work on this issue?

[Wck-iipi]

@Peefy I tried kcl test after building kcl but none of the subcommands with kcl are currently working. I am currently on MacOS 14.5. The only subcommands that I am being shown are run, server, version and help.

Even the make doesn't show any errors.

Below is my zshrc file which has set kcl as alias for kclvm_cli.

Moreover, even testing package cannot be imported.

Any idea why I can't see any subcommands or I cannot import testing? Have I not installed something? Thanks for the help.

[Peefy]

Hello @Wck-iipi.

You can install full KCL CLI from https://github.com/kcl-lang/cli and prevent alias kcl

[Wck-iipi]

@Peefy, But it cannot still find testing.

[Peefy]

@Wck-iipi

The content I wrote in the issue is the expected functionality rather than the existing functionality.

[Wck-iipi]

@Peefy Thanks for responding. Could you tell me where I have to write this catch_err code at? Would it be at /tools/src/testing? I am a little confused with the implementation. Also, when I finally create the catch_err function, how would user use that function?

[Peefy]

I think that we need to achieve two things here.

1. Implement the testing system module and add some functions to assist in unit testing.
2. Implement a compiler runtime plugin that can capture erroneous exceptions to prompt users.
3. recover function from the runtime panic like go and rust.

Furthermore, this is not a simple function that requires a design solution first and then implementation.

[Wck-iipi]

@Peefy Could you give me some references that would tell me more about this(like some PR where you have created/modified compiler runtime plugin or testing system module)? Because upon searching import testing, I came across some examples like this, which is useful, but I would like if you could guide me more. Thanks.

[Peefy]

You can try impl runtime panic recovery like go and rust. 😃