WebFuzzing / EvoMaster

The first open-source AI-driven tool for automatically generating system-level test cases (also known as fuzzing) for web/enterprise applications. Currently targeting whitebox and blackbox testing of Web APIs, like REST, GraphQL and RPC (e.g., gRPC and Thrift).
GNU Lesser General Public License v3.0
454 stars 77 forks source link

Fix JS & Dotnet minimization #996

Closed jcbasso closed 1 month ago

jcbasso commented 1 month ago

While working in a driver and comparing it with different test SUTs I found that JS and Dotnet were having a big difference on line coverage when comparing it with Java solution. (from expected ~95% to ~55% of line coverage in NCS)

A bit more of debugging made me realize that the issue was when using the param minimization=true.

After a bit of more debugging I found that there was added in 2.0.0 (if I am not mistaken) a new param in the testResults endpoint called allCovered that was being ignored in both controllers.

I added this new param in both of them and from my testings in NCS looks like everything is working as intended now hitting the expected line coverage with both drivers.

arcuri82 commented 1 month ago

hi @jcbasso ,

thanks for your interest in EM, but, as stated in the documentation: Note: there was initial support for other languages as well, like for example JavaScript/TypeScript and C#, but they are not in a stable, feature-complete state. The support for those languages has been dropped, at least for the time being.

we no longer support JS and C# for backend instrumentation (it is way too much work, unfortunately).

jcbasso commented 1 month ago

Oh alright Andrea, thanks for the input!

Feel free to close the PR then if you believe you don't want to add new changes to them!