search

jsdelivr / globalping-hwprobe

OS image for Globalping hardware probes. Become a GitHub Sponsor to get yours!
19 stars 6 forks source link

v2 final testing #40

Closed jimaek closed 4 months ago

jimaek commented 7 months ago

After everything is merged and no other features are planned need to make sure the final firmware is stable:

  1. Load it on multiple devices. From old batch and new batch for a few weeks.
  2. Build a firmware with 0.28 container and test the container update process
  3. Build a firmware with 0.29 container and test the container update process (after 0.30 is released)
  4. Monitor closely and check logs to ensure its not crashing or has update loops
  5. Ensure the weekly reboots don't break anything
  6. Ensure the sd card is protected from abuse
  7. Ensure RAM is enough to do all of the above, even if the container increases in size
  8. Measure time to start the container
  9. other?
  10. Start shipping
kernelgurumeditation commented 6 months ago

@jimaek Current test status:

  1. Load it on multiple devices. From old batch and new batch for a few weeks.

I only have one HW unit.. and more importantly, don't have the exact sdcard brand/model that will be used...

  1. Build a firmware with 0.28 container and test the container update process

Done, no issues found

  1. Build a firmware with 0.29 container and test the container update process (after 0.30 is released)

Partially done, (faked the version) no issues found

  1. Monitor closely and check logs to ensure its not crashing or has update loops

Looks ok, my HW probe has been running a test that simulates increased time speed (to test weekly reboot and version checks) No issues were found in about 500-week reboot/version check cycles

  1. Ensure the weekly reboots don't break anything

See issue 4.

  1. Ensure the sd card is protected from abuse

No writes are done to the card if no new version is available

  1. Ensure RAM is enough to do all of the above, even if the container increases in size

The RAM size is limited, I will run a couple of tests to see how much the container could safely increase in size

  1. Measure time to start the container

not done

  1. other?
  2. Start shipping

🔥 🥳 😨

jimaek commented 6 months ago

I only have one HW unit.. and more importantly, don't have the exact sdcard brand/model that will be used...

I will send you a unit from the new batch with the new SD card once I get them :)

MartinKolarik commented 6 months ago

We'll also release a new probe version for testing soon.

MartinKolarik commented 6 months ago

New probe version released. Can be tested and then we can start merging things here.

MartinKolarik commented 5 months ago

@kernelgurumeditation please test one more time the upgrade from 0.29.0 to v0.31.1 and if everything looks good, let's merge.

kernelgurumeditation commented 5 months ago

@MartinKolarik, ok, I will do the test tomorrow and report

kernelgurumeditation commented 5 months ago

@MartinKolarik test done, and everything was successful Probe firmware v2 looks to be stable

skapytek commented 5 months ago

How to get the v2 probe?

jimaek commented 4 months ago

@skapytek Its now live https://github.com/jsdelivr/globalping-hwprobe/releases/tag/v2.0 Let me know if you encounter any errors