search

janexner / site-infrastructure-tests

Test framework that allows analysts/marketers to specify site infrastructure regression tests for dev
Apache License 2.0
23 stars 8 forks source link

Need Info #1

Open vikramvi opened 6 years ago

vikramvi commented 6 years ago

Hi,

Please clarify below doubts

janexner commented 6 years ago

Hi there,

The tests are tool agnostic. They are supposed to test the infrastructure underneath the tools. Is the data layer in place and is it complete? Are certain key elements present and do they have the correct values? Questions like that are not related to the analytics tool used. More crucially, those questions are in the realm of the developer, not the analytics team.

If you want to understand the idea, may I point you to https://webanalyticsfordevelopers.com/2017/05/30/more-tests-more-fun/, https://webanalyticsfordevelopers.com/2016/03/01/what-to-test/, and maybe https://webanalyticsfordevelopers.com/2016/05/31/my-summit-session-now-viewable-online/.

I also built a test page that is easy to understand: https://www.jan-exner.de/orm/lab/ (no, I do NOT have a book)

Does that help?

vikramvi commented 6 years ago

@janexner Thanks for update, I'm from QA automation background and looking for solution to test web analytics.

Your project looks promising but frankly I'm finding it hard to understand.

e.g.

A JSON file (testdescription.json) contains all pages to be tested along with their tests but it's not clear what kind of tests this executes.

which test description the test suite will read by specifying the test.description.file property couldn't find this file.

If you can revisiting and rephrase README keeping QA community ( who are new to analytics ) in mind can be of great help. Thanks in advance.

vikramvi commented 6 years ago

@janexner can you please review above comment and do the needful ? Thanks in advance.