Create test scenarios

[prmr]

Create a list of scenarios that describe one walk-through of the entire state space of Creco, from product search to feature-sensitive ranking. These can be documented in /doc/scenarios/

[priyasidhaye]

I have written these scenarios :

A.

1. Type 'Smart Phones' in search box
2. Click 'Search'
3. Select 'Smart Phone'
4. Mouse over to help button in attributes and change values in a few.
5. Change checkbox values of features: Display size, Portability
6. Select 'Submit' Products ranking should change.
7. Go back to search to Cell Phone Carriers.

B.

1. Search for type 'Cell phone'
2. Select 'Cell Phone Carrier'
3. In the feature selector, select Ratings
4. Change check boxes for features : Voice, Data, texting
5. Select 'Submit'
6. Browse through products and select one

C.

1. Look for 'Toaster'
2. Select 'Toaster' from Search Results
3. One slice, ease of cleaning
4. Check if product list changes based on features selected through checkboxes.
5. Browse product list.

Are these okay?

[prmr]

These should include the expected output. For example, for scenario 'A', currently the system does not show iphone autocompletions. I'll open an issue for this.

[prmr]

This should include concurrent access scenarios to detect problems like in issue #81

[priyasidhaye]

I have written more of these considering all these scenarios. Should I add it as an html to docs/scenarios?

[priyasidhaye]

Here are the updated test case scenarios

Test Scenarios	Description	Action	Expected Action
1	Walk-through of application	Type 'Smart Phones' in search box.	Search bar should show an auto-complete list with category.
		Click 'Search'	A list of categories relating to the search query should show up on the same page.
		Select 'Smart Phone' category.	A new page with a list of products and a list of features should be seen.
		Select some features from the list of features.	The ranked list of products should refresh dynamically on each click of a checkbox and change the order based on what feature is selected.
		Select 'Acatel OneTouchEvolve'.	The page should be redirected to the Consumer Reports page for the product.
2	Second search from Products page	Search for category 'Toaster'	Categories related to 'Toaster' should show on the page.
		Select 'Toaster' category from the categories available	The page should be redirected to a new page with the products from 'Toaster' category.
		In the search bar, type 'babies'.	Auto-complete should show results of categories similar to the query babies.
		Hit 'Submit'.	The page should be redirected to the first results page with categories and 'Baby Monitor' category should be seen.
		Select 'Baby Monitor'	Page should be redirected to the products page. The products list should contain lin ks to baby monitors.
		Browse through products and select one.	Should lead to the ConsumerReports page for the selected product.
3	Concurrent Access from same browser.	In one tab search for 'Toaster'	Should show categories for 'Toaster' matching result from Auto complete.
		In another tab search for 'Humidifier'	Show categories matching 'Humidifier'.
		Go back to first tab and select 'Toaster' category.	Should redirect to a new page in this tab showing products of category 'Toaster'.
		In the second tab select the 'Humidifier' category	Should redirect to a new page in this tab showing products of category 'Humidifier' in the second tab.
		In the product links page, change values of check boxes for attributes and refresh product list.	The 'Humidifier' category products list should be reshuffled according to the features selected.
		Go back to the 'Toaster' and perform feature selection with different features.	The products of the category 'Toaster' should reshuffle according to the features selected in this tab.
4	Test dead product links.	Search for 'cars' in the search box.	The page should show the categories related to the query 'cars'.
		Select the cateogory 'Car Repair Shops'.	The products page should be seen with the features and the various brands of cars.
		Click on the product 'Audi'.	The product links are dead, hence the click is ineffective and are returned back to the same page.
5	Test on different browsers.	Carry out test case scenario 1 in multiple browsers - Chrome, Firefox.	The website features like Autocomplete and formatting of the pages should be visible and same across all the browsers.

[asutcl]

I put the application in front of a friend yesterday and just asked him to type search for something. I don't know if these still hold given the improved UI but nevertheless, this is what happened:

He first typed in baseball glove. For which the category water filter popped up alone.

I asked him to try again. This time he typed in broom. Nothing showed up. He then typed underwear, and again nothing showed up.

At this point I intervened and said we had electronics and that he should try one of those. So he typed in fridge. I saw the auto-complete pop up briefly. Once he had completed the word nothing showed and nothing was found for fridge. I admit this is a tricky query because fridge is common slang. He then erased until only fri. From the auto-complete list he picked side-by-side refrigerator. At this point, he was presented with the categories which were exactly the ones he picked in the auto-complete. He clicked side-by-side again.

At that point he didn't know what to do so I told him he could click the attributes on the side to sort the list. He clicked Exterior Height. The list changed but afterwards the application stopped responding and an error popped up.

I have reproduced this error, many times. Side-by-side refrigerator seems to make the application hang.

Overall, I think we need more naive test scenarios. The test scenarios we have now assume a certain know how with the application.

[mangalagb]

I tried the exact same steps and it is working for me ! It takes longer to refresh the page after selecting Exterior Height but the application does not hang.

[priyasidhaye]

These can be edited directly in /docs/scenarios/ now, so I'll close this issue for this milestone?

[enewe101]

sounds good