CarnegieLearningWeb / UpGrade

Framework for adding A/B testing to education applications
https://www.upgradeplatform.org/
BSD 3-Clause "New" or "Revised" License
25 stars 12 forks source link

Enrollment and metrics data not showing up for stratified random sampling experiment #1391

Open amurphy-cl opened 3 months ago

amurphy-cl commented 3 months ago

Version where bug was found: Version: v5.1.4

Describe the bug Created an AA experiment with site: SelectSection and target: absolute_value_plot_equality with strata fsl_status from csv upload.

Created 10 users in MATHia staging, logged in and did math for each user to collect enrollments and metrics data. Set metrics to capture timeSeconds and workspaceCompletionStatus.

Enrollments and metrics data in the UI were both blank after logging in and successfully getting conditions for 9/10 test users.

Expected behavior Enrollment and metrics data should be visible in the UI.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

RidhamShah commented 3 months ago

@amurphy-cl I have tested this issue by creating an SRS experiment locally using REST API and all seems to be working fine. Can you tell me which client version is hosted upgrade is working on, so I can test more about it?

amurphy-cl commented 3 months ago

Here's a list of UUIDs who received the correct assignment in Splunk, let's see if there was a problem with /mark

dcd22d1a-5ff3-443a-9d91-febd711d9d02 dd37f433-daae-4139-b70e-02ff2786e093 4c92a948-7a0d-4def-93dd-f18c3402b3a5 a8ddd23f-5c93-4fb3-9b8d-d0b5cb4fdfeb f86c9a59-33d2-4210-b9fc-98546ed78d1d d76fb1e7-fa82-4b3c-9964-ba84e6e25212 a9c6f2c4-5425-4f81-b435-6060f18dfc69 cfe46839-1e18-4978-b5e8-e716ef669555 f780060c-cbd6-4e68-9076-5201d921f185

RidhamShah commented 3 months ago

@amurphy-cl I imported the experiment and tested assign and mark calls on multiple users, using REST API and from client-side-SDK but everything seems to work perfectly fine. To replicate this issue I think I need db-data or some more information,