QNAP Testplan

[jnweiger]

Template: https://github.com/owncloud/QA/blob/master/Integrations/Test_Plan_QNAP.md

Run the testplan template twice: first x86, second arm7, see below.

[jnweiger]

Test Plan x86 (QNAP TVS-427XT)

Setup

Two QNAP NAS are in the office reachable via VPN -> see Confluence

• Test on a known state device

  • no ownCloud app installed (installation from scratch)
  • previous ownCloud app version installed (upgrade case)

• [ ] when using Licenses from "Stage Store" / "Alpha License"

  • [x] install QDevelop App first from Confluence and set the environment to "Alpha"
  • [ ] start VPN, start Socks Proxy (ssh command), configure browser to use socks proxy -> you can now visit https://stage-software.qnap.com and https://alpha-license.qnap.com, exact instructions see Confluence

Test items

• [x] Installation

  • [x] by uploading QPKG for x86 (while not released) * [ ] from QNAP Appstore for x86 (when available in Appstore)

• [x] ownCloud App icon is on the homescreen
  • [x] clicking the ownCloud App icon opens the ownCloud web interface
• [x] QR codes on login page
  • [x] Google Playstore leads to https://play.google.com/store/apps/details?id=com.owncloud.android
  • [x] Apple Appstore leads to https://apps.apple.com/de/app/owncloud-file-sync-and-share/id1359583808
  • [x] The QR codes will be enlarged when hovering over them https://github.com/owncloud/theme-qnap/issues/3
• [x] Login as admin, with password admin
• [x] configure ownCloud email settings (eg. by using MailHog on qnap-teamviewer-proxy.owncloud.works)
• [ ] Licensing
  • [x] Under Settings -> General there is NO input field for a EE license key
  • [x] ownCloud CE
  • [x] There is no ownCloud license in the QNAP license manager, if so remove it
    • [x] ownCloud reports that itself is a CE
    • [x] the license table is empty
    • [x] the license information above the license table says 5 users are allowed
    • [x] the current user count above the license table says 1 user is active
  • [x] create 5 more users (so that you have 6 in total)
    • [x] the current user count above the license table says 6 users are active
    • [x] after a maximum waiting time of 60 seconds
    • [x] the last added user is deactivated (see users overview)
    • [x] the current user count above the license table says 5 users are active
    • [x] all admins have a notification which informs about the exceeding of licensed users
    • [x] all admins have an email wich informs about the exceeding of licensed users
    • [x] the deactivated user can not log in (error message says user deactivated)
  • [x] EE apps installed to a CE https://jira.owncloud.com/browse/QNAPN-75
    • [x] admins will see NO grace period message after activating first EE app (trial period was triggered internally, but message is disabled for QNAP)
    • [x] manually shorten trial period by setting it shortly before expiry occ config:app:set core grace_period --value=$(date +%s -d "-24 hours + 120 seconds")
    • [x] when trial period expired after 120 seconds
    • [x] all EE apps are disabled
    • [x] all EE apps are disabled shortly after activation (try to activate EE apps)
  • [x] unlimited guest users https://github.com/owncloud/qnap/issues/17
    • [x] enable Guests app
    • [x] create a share and share it to at least 6 email addresses
    • [x] the current user count above the license table says 5 users are active
    • [x] after a minimum waiting time of 60 seconds
      • [x] no normal user is be deactivated
      • [ ] all guest users can sign up / log in with the link they received
  • [x] ownCloud EE
  • [x] add one 5-seat 1-year license to the QNAP license manager (you may obtain it from the Alpha store)
    • [x] ownCloud reports that itself is a EE
    • [x] the license table shows the license you added (right license number, start and expiry date, number of licensed users)
    • [x] the license information above the license table says 5 users are allowed
  • [x] delete all users except five and then create one more users (so that you have 6 in total)
    • [x] the current user count above the license table says 6 users are active
    • [x] after a maximum waiting time of 60 seconds
    • [x] the last added user is deactivated (see users overview)
    • [x] the current user count above the license table says 5 users are active
    • [x] all admins have a notification which informs about the exceeding of licensed users
    • [x] all admins have an email wich informs about the exceeding of licensed users
    • [x] the deactivated user can not log in (error message says user deactivated)
  • [x] add one 5-seat 1-year license to the QNAP license manager (you may obtain it from the Alpha store)
    • [x] ownCloud still reports that itself is a EE
    • [x] the license table shows the two licenses you added (right license number, start and expiry date, number of licensed users)
    • [x] the license information above the license table says 10 users are allowed
    • [x] the current user count above the license table says 5 users are active
  • [x] enable the 6th user which has been deactivate before
    • [x] the user will stay active
    • [x] the current user count above the license table says 6 users are active
  • [x] add 5 more users
    • [x] all users, except the last one, will stay active
    • [x] the current user count above the license table says 10 users are active
  • [x] remove one 5-seat 1-year license from the QNAP license manager
    • [x] ownCloud reports that itself is a EE
    • [x] the license table shows only the license you did not remove (right license number, start and expiry date, number of licensed users)
    • [x] the license information above the license table says 5 users are allowed
    • [x] the current user count above the license table says 10 users are active
    • [x] after a maximum waiting time of 60 seconds
    • [x] the last added users are deactivated (see users overview)
    • [x] the current user count above the license table says 5 users are active
    • [x] all admins have a notification which informs about the exceeding of licensed users
    • [x] all admins have an email wich informs about the exceeding of licensed users
    • [x] the deactivated user can not log in (error message says user deactivated)
  • [x] unlimited guest users https://github.com/owncloud/qnap/issues/17
    • [x] enable Guests app
    • [x] create a share and share it to at least 6 email addresses
    • [x] the current user count above the license table says 5 users are active
    • [x] after a minimum waiting time of 60 seconds
      • [x] no normal user is be deactivated
      • [ ] all guest users can sign up / log in with the link they received
  • [x] EE apps installed to a EE
    • [x] EE apps can be used without limitation
  • [x] remove all licenses from QNAP license manager
    • [x] ownCloud reports that itself is a CE
    • [x] the license table is empty
    • [x] the license information above the license table says 5 users are allowed
    • [x] all guest users are still active
    • [x] all EE apps are disabled (fallback to EE would have triggered a trial period, but that was already used during CE above)
    • [x] all EE apps are disabled shortly after activation (try to activate EE apps)
• [x] Retreive ownCloud server log via WebUI, according to the [Docs]
• [x] Connect a share from the NAS as external storage
  • [x] create a share on the QNAP device -> see Confluence
  • [x] set up external storage with the SMB app
  • [x] set up external stroage with the WND app (activate EE before that)

Further test items

• [ ] test upgrade path from previous ownCloud app
• [ ] Test when purchased license expires - user settings fall back to default 5 users oC CE.
• [ ] Check the performance impact of QNAP license implemenation (noticeable slowdown or not)
• [ ] Backup and Restore

Cleaning up

• [ ] Merge testplan updates back to the template

[jnweiger]

Test Plan arm7 (QNAP TS-431X)

Setup

Two QNAP NAS are in the office reachable via VPN -> see Confluence

• Test on a known state device

  • no ownCloud app installed (installation from scratch)

• [x] when using Licenses from "Stage Store" / "Alpha License"

  • [x] install QDevelop App first from Confluence and set the environment to "Alpha"
  • [x] start VPN, start Socks Proxy (ssh command), configure browser to use socks proxy -> you can now visit https://stage-software.qnap.com and https://alpha-license.qnap.com, exact instructions see Confluence

Test items

• [x] Installation

  • [x] by uploading QPKG for ARM (while not released) * [ ] from QNAP Appstore for ARM (when available in Appstore)

• [x] ownCloud App icon is on the homescreen
  • [x] clicking the ownCloud App icon opens the ownCloud web interface
• [x] QR codes on login page
  • [x] Google Playstore leads to https://play.google.com/store/apps/details?id=com.owncloud.android
  • [x] Apple Appstore leads to https://apps.apple.com/de/app/owncloud-file-sync-and-share/id1359583808
  • [x] The QR codes will be enlarged when hovering over them https://github.com/owncloud/theme-qnap/issues/3
• [x] Login as admin, with password admin
• [x] configure ownCloud email settings (eg. by using MailHog on qnap-teamviewer-proxy.owncloud.works)
• [ ] Licensing
  • [x] Under Settings -> General there is NO input field for a EE license key
  • [ ] ownCloud CE
  • [x] There is no ownCloud license in the QNAP license manager, if so remove it
    • [x] ownCloud reports that itself is a CE
    • [x] the license table is empty
    • [x] the license information above the license table says 5 users are allowed
    • [x] the current user count above the license table says 1 user is active
  • [x] create 5 more users (so that you have 6 in total)
    • [x] the current user count above the license table says 6 users are active
    • [x] after a maximum waiting time of 60 seconds
    • [x] the last added user is deactivated (see users overview)
    • [x] the current user count above the license table says 5 users are active
    • [x] all admins have a notification which informs about the exceeding of licensed users
    • [x] all admins have an email wich informs about the exceeding of licensed users
    • [x] XXX the deactivated user can not log in (error message says ~user deactivated~ User disabled)
  • [ ] EE apps installed to a CE https://jira.owncloud.com/browse/QNAPN-75
    • [ ] admins will see NO grace period message after activating first EE app (trial period was triggered internally, but message is disabled for QNAP)
    • [ ] manually shorten trial period by setting it shortly before expiry occ config:app:set core grace_period --value=$(date +%s -d "-24 hours + 120 seconds")
    • [ ] when trial period expired after 120 seconds
    • [ ] all EE apps are disabled
    • [ ] all EE apps are disabled shortly after activation (try to activate EE apps)
  • [ ] unlimited guest users https://github.com/owncloud/qnap/issues/17
    • [ ] enable Guests app
    • [ ] create a share and share it to at least 6 email addresses
    • [ ] the current user count above the license table says 5 users are active
    • [ ] after a minimum waiting time of 60 seconds
      • [ ] no normal user is be deactivated
      • [ ] all guest users can sign up / log in with the link they received
  • [ ] ownCloud EE
  • [ ] add one 5-seat 1-year license to the QNAP license manager (you may obtain it from the Alpha store)
    • [ ] ownCloud reports that itself is a EE
    • [ ] the license table shows the license you added (right license number, start and expiry date, number of licensed users)
    • [ ] the license information above the license table says 5 users are allowed
  • [ ] delete all users except five and then create one more users (so that you have 6 in total)
    • [ ] the current user count above the license table says 6 users are active
    • [ ] after a maximum waiting time of 60 seconds
    • [ ] the last added user is deactivated (see users overview)
    • [ ] the current user count above the license table says 5 users are active
    • [ ] all admins have a notification which informs about the exceeding of licensed users
    • [ ] all admins have an email wich informs about the exceeding of licensed users
    • [ ] the deactivated user can not log in (error message says user deactivated)
  • [ ] add one 5-seat 1-year license to the QNAP license manager (you may obtain it from the Alpha store)
    • [ ] ownCloud still reports that itself is a EE
    • [ ] the license table shows the two licenses you added (right license number, start and expiry date, number of licensed users)
    • [ ] the license information above the license table says 10 users are allowed
    • [ ] the current user count above the license table says 5 users are active
  • [ ] enable the 6th user which has been deactivate before
    • [ ] the user will stay active
    • [ ] the current user count above the license table says 6 users are active
  • [ ] add 5 more users
    • [ ] all users, except the last one, will stay active
    • [ ] the current user count above the license table says 10 users are active
  • [ ] remove one 5-seat 1-year license from the QNAP license manager
    • [ ] ownCloud reports that itself is a EE
    • [ ] the license table shows only the license you did not remove (right license number, start and expiry date, number of licensed users)
    • [ ] the license information above the license table says 5 users are allowed
    • [ ] the current user count above the license table says 10 users are active
    • [ ] after a maximum waiting time of 60 seconds
    • [ ] the last added users are deactivated (see users overview)
    • [ ] the current user count above the license table says 5 users are active
    • [ ] all admins have a notification which informs about the exceeding of licensed users
    • [ ] all admins have an email wich informs about the exceeding of licensed users
    • [ ] the deactivated user can not log in (error message says user deactivated)
  • [x] unlimited guest users https://github.com/owncloud/qnap/issues/17
    • [ ] enable Guests app
    • [ ] create a share and share it to at least 6 email addresses
    • [ ] the current user count above the license table says 5 users are active
    • [ ] after a minimum waiting time of 60 seconds
      • [ ] no normal user is be deactivated
      • [ ] all guest users can sign up / log in with the link they received
  • [ ] EE apps installed to a EE
    • [ ] EE apps can be used without limitation
  • [ ] remove all licenses from QNAP license manager
    • [ ] ownCloud reports that itself is a CE
    • [ ] the license table is empty
    • [ ] the license information above the license table says 5 users are allowed
    • [ ] all guest users are still active
    • [ ] all EE apps are disabled (fallback to EE would have triggered a trial period, but that was already used during CE above)
    • [ ] all EE apps are disabled shortly after activation (try to activate EE apps)
• [ ] Retreive ownCloud server log via WebUI, according to the [Docs]
• [ ] Connect a share from the NAS as external storage
  • [ ] create a share on the QNAP device -> see Confluence
  • [ ] set up external storage with the SMB app
  • [ ] set up external stroage with the WND app (activate EE before that)

Further test items

• [x] test upgrade path from previous ownCloud app
• [ ] Test when purchased license expires - user settings fall back to default 5 users oC CE.
• [ ] Check the performance impact of QNAP license implemenation (noticeable slowdown or not)
• [ ] Backup and Restore

Cleaning up

• [ ] Merge testplan updates back to the template