search

adlnet / lrs-conformance-test-suite

A NodeJS project that tests the MUST requirements of the xAPI Spec and is based on the ADL testing requirements repository. The test suite website can be found here: https://lrstest.adlnet.gov/. The adopters website can be found here: https://adopters.adlnet.gov/
https://adlnet.gov/projects/xapi/
MIT License
65 stars 42 forks source link

Issue with Testing v2.0.0 , Testing result add up incorrectly. #271

Open BananaDuncan1024 opened 3 months ago

BananaDuncan1024 commented 3 months ago 
 node bin/console_runner.js -e http://localhost:7071/api/v1/lrs -x "2.0.0"

Hello ! Based on the title mentioned, the current testing status shows that the sum of passed and failed tests does not match the total count. Additionally, an error occurs during the final execution. Could it be that my Node version is too new? Or there is any recommend Node version?

截圖 2024-07-04 清晨5 04 37

Also when i tried in Node v16.14.2 , total count become correctly.

截圖 2024-07-04 清晨5 15 21

Finally , I have some questions about the testing data. Apologies, I'm not very familiar with unit testing. Is it normal for the URL of the test data to be inaccessible?

截圖 2024-07-04 清晨5 20 16

it's there any solution can i fixed the problem of this incorrect total result at node v20? Please help , Thank you!

vbhayden commented 3 months ago

Interesting, I'll check this over the weekend -- thanks for bringing it up!

vbhayden commented 2 months ago

Morning @BananaDuncan1024,

So I ran it just now using NodeJS version 20.15.1, and (while it had louder complaints about the use if Buffer) it seemed to run against the default ADL LRS just fine. It looks like it's having some trouble finding a log file or something -- does your console give any more information about that?

For the "fileUrl` bit, that's just a URI for the test -- not intended to be accessible in this case etc. :-)