matomo-org / matomo

Empowering People Ethically with the leading open source alternative to Google Analytics that gives you full control over your data. Matomo lets you easily collect data from websites & apps and visualise this data and extract insights. Privacy is built-in. Liberating Web Analytics. Star us on Github? +1. And we love Pull Requests!
https://matomo.org/
GNU General Public License v3.0
19.87k stars 2.65k forks source link

Run automated piwik.js tests on more browsers than just webkit (modern IE, firefox, ...) #9874

Open mattab opened 8 years ago

mattab commented 8 years ago

As we announce to users & clients that our JavaScript Tracking SDK supports many browsers, it is important to run our automated test suite on more than just webkit.

How could we use a web service, such as saucelabs, to run our automated piwik.js tests on more browsers?

sgiehl commented 8 years ago

Maybe also BrowserStack would be worth a try: https://www.browserstack.com/javascript-testing-api

tsteur commented 8 years ago

An idea could be to create one selenium test that checks that all testsuites of http://piwik.example.com/tests/javascript/ were executed successfully. Then we can open this page via selenium and run them in different browsers via BrowserStack or SauceLabs. We won't be able to run them on CLI via phantomjs

Be aware that the tests are not written to run in all browsers. Eg I'm pretty sure they won't run in < IE8 I think.

mattab commented 8 years ago

FYI: we now have a ‘Solo Live’ and ‘Basic Automate’ plan account at BrowserStack.com :+1: