search

getappmap / appmap-ruby

AppMap client agent for Ruby
https://appland.org
Other
98 stars 11 forks source link

When running a test suite, only first test gets converted to AppMap #356

Open gonzric1 opened 3 months ago

gonzric1 commented 3 months ago

Expected Behavior: When I run all tests in a file with many tests, all tests return an appmap accessible via the VSCode/Intellij interface.

Actual Behavior: Only first test in file generates an appmap.

When running tests on a file with many tests, all of the files get recorded as a #{test_name}.appmap.json file, but only the first test in each file gets converted to a folder and shows up in the appmap extension.

This seems to happen consistently with controller specs, but not with model specs.

You can get around this by running each test case individually. However, if I try running all tests in a folder, only the first it... statement in each file creates an appmap.

kgilpin commented 3 months ago

Hi, can you provide your Ruby version and RSpec version? Maybe rspec has changed in a way that’s outside of our test matrix.

gonzric1 commented 3 months ago

ruby '3.2.2' 'rspec-rails', '5.1.1'

kgilpin commented 3 months ago

Related: https://github.com/getappmap/appmap-js/pull/1704

should allow the AppMaps to load regardless of stray “returns”.

It seems that something in the test environment of this project (the project that is exhibiting this problem when running specs) is maybe a long running thread that’s producing random call events.