search

Unicity / Gauntlet

A test runner for comparing outputs of HTTP endpoints (Team: US-Backend PM: Mike W.)
Apache License 2.0
1 stars 0 forks source link

Can Gauntlet compare CSV output? #15

Open bluetechy opened 8 years ago

bluetechy commented 8 years ago

@powerc9000 Is it currently possible to compare CSV output using Gauntlet? If not, this would be a beneficial feature to have.... Ideally, we would want to see which field is different not just the line.

powerc9000 commented 8 years ago

@bluetechy Right now it will compare any file that doesnt have content-type xml or json as text. So in a very limited way yes, but we can improve that.

dimitry12 commented 8 years ago

@powerc9000 please take a look at service=CreateDirectCredit/Commerce-JPM/Navision-CAL&country=CA.t1-test? Diff-tool reports no difference, but gauntlet claims it doesn't pass.

powerc9000 commented 8 years ago

@dimitry12 that specific test is fixed in b6db0dea1ab4e5369110be083d665bf535158ad4

powerc9000 commented 8 years ago

@dimitry12 The problem was differences in line endings.

bluetechy commented 8 years ago

@powerc9000 In this particular case, the type of EOL character is important because the final processing system requires CRLF. Files will be rejected or incorrectly processed when the wrong EOL character is used.

dimitry12 commented 8 years ago

@bluetechy that's hardcore :)

@powerc9000 should that fix be partially reverted for gauntlet to check for exact line-endings match?

bluetechy commented 8 years ago

@dimitry12 We can thank Microsoft and JPM for that.

bluetechy commented 8 years ago

@dimitry12 Can you correct the EOL characters in your output file to use CRLF for this particular test? Also, let's add a note to this test using the new JSON format that @powerc9000 added to indicate that EOL characters are important.

dimitry12 commented 8 years ago

@bluetechy I used the files you emailed me verbatim. Please, update with what you have if you have different output.