We're evaluating ExVCR and we had the funniest surprise.
After recording a bunch of requests and removing connectivity to the external service, all our tests stayed green. However, we noticed that things that should turn red don't. Namelly:
Changing URL query params (even tho they're in the cassettes),
Changing multipart / form-data, or even completelly removing it.
Is that a known behaviour? How to make sure that the results are reliable?
Initially I thought that match_requests_on: [:query, :request_body] was a Config. I realised that it had to be used as parameters of the use_cassette macro.
We're evaluating ExVCR and we had the funniest surprise.
After recording a bunch of requests and removing connectivity to the external service, all our tests stayed green. However, we noticed that things that should turn red don't. Namelly:
Is that a known behaviour? How to make sure that the results are reliable?
Example 1:
If we change the value of
url
afterarg=
, the tests stay green.Example 2:
If in our source code we completelly remove the multipart attachement, everythign stays green.