wet-boew / wet-boew-styleguide

A style guide for the Web Experience Toolkit.
http://wet-boew.github.io/wet-boew-styleguide/index-en.html
36 stars 32 forks source link

Heuristic evaluation - Tabbed Interface with slide-horz #37

Open rubinahaddad opened 10 years ago

rubinahaddad commented 10 years ago

Please perform a heuristic review of the following component: Tabbed Interface with slide-horz example.

Performing a heuristic evaluation

  1. Post a comment on this issue indicating that you will perform a heuristic evaluation of the component. If you see that at least three people have already indicated that they are performing a heuristic evaluation, consider reviewing another component.
  2. Use the heuristic template to guide your evaluation.
  3. Make sure that you review all responsive states of the component.
  4. Once you have completed your evaluation, post the results as a comment on this issue as follows:
    • For each heuristic, display the heading containing the letter of the section, and the number of the heuristic. Below each heading, provide the results of your evaluation of that heuristic. (e.g., B. Provide status feedback 1. Your result).
    • Make sure you specify which responsive state each result applies to. If a result applies to all responsive states, specify that it applies to all responsive states.
JxRath commented 10 years ago

Tabbed Interface with slide-horz: http://www.cic.gc.ca/english/games/museum/1.asp

A. Please indicate which devices were tested (Desktop/Mobile/Tablet): IE Windows 8.0.7601.17514, HP Desktop, Dell widescreen monitor (1920x1080) Apple iPhone 4, latest iOS 7

Note: there are Errors on this page. The header search field and menu do not render properly. This may cause, or add to, other errors in the component.

B. Provide status feedback

  1. Does the component always let users know about its current status?

IE 8: No. This component does not work properly with IE 8.

When the page first loads the first line in the content area is “Artefacts in Room 1 – Early settlement.” This is followed by 15 stacked horizontal bars with numbers centered in them. The bars span the full width of the page. At the bottom of the stack there are two Blank bars with nothing in them (I think these were supposed to contain left and right facing arrows).

The area under the bars contains an image with the header “Certificate of Freedom, 1783” followed by two columns of text and some links to the other “Rooms”

When the user rollls-over the horizontal bars they turn darker grey indicating that they can be clicked and likely link to other pages. Clicking on these bars does nothing – the links do not work.

iOS 7: Somewhat. When following the link provided on the heuristics evaluation page in iOS 7 I was brought to Room 2, while in IE 8 I was brought to Room 1. In both cases I should have been brought to the “Lobby”. The page controls seem to work in iOS 7 letting me know what page I was on by the numbered page highlight. The Arrow buttons also worked as expected.

  1. Does the component give immediate, easy to understand feedback?

IE 8: No. This component does not work properly with IE 8.

iOS 7: Yes. The button controls and links worked and I was able to navigate through the site.

  1. Will the user have enough visual cues to easily complete the component’s tasks?

IE 8: No. This component does not work properly with IE 8.

iOS 7: Yes. The button controls and links worked as expected (more or less) and I was able to navigate through the site.

  1. If some part of a component is hidden, can users see something that allows them to bring it in and out of view?

IE 8: No. This component does not work properly with IE 8. Links do not work, so hidden content and linked pages cannot be seen.

C. Match real world conventions

  1. Do parts of the component match what you see, hear (if any) and touch (if any) meet common expectations and are they easily recognizable?

IE 8: No. This component does not work properly with IE 8. Buttons highlight but when clicked they do not work.

iOS 7: Yes. The page controls and links worked as expected, although the numbered buttons sometimes rendered on top of text below the buttons partially obscuring it.

  1. When users perform actions within the component, are the results they get what they would commonly expect?

IE 8: No. This component does not work properly with IE 8. Links and buttons do not work as expected.

iOS 7: Yes. The buttons, highlighted buttons, links and visited links worked as expected. D. Apply standards and ensure consistency

  1. Have industry formatting standards been used consistently throughout?

IE 8: No. This component does not work properly with IE 8. Formatting of buttons does not work – they span the full page in a vertical stack which is not the intended layout. Also the left and right arrows do not appear.

iOS 7: Somewhat. The buttons render in multiple rows, which is not ideal, and they also occasionally obscure the text underneath it.

  1. Is there a logical and consistent usage of elements throughout the component?

IE 8: No. This component does not work properly with IE 8.

iOS 7: Somewhat. The buttons do not remain a consistent size when shifting from portrait mode to landscape mode.

  1. Is there a consistent usage of language that is clearly understandable, relevant, concise, current and to the point throughout the component?

N/A

  1. Is the experience consistent across screen sizes?

No. The experience renders differently in iOS and IE 8.

iOS 7: The numbered buttons stack up in 3 rows. First row, 1 through 9; Second row, 10 through 15 with a left arrow; Third row, Right facing arrow. The right facing arrow in the third row renders on top of the “Certificate of Freedom” text partially obscuring it.

iOS 7: When the user switches from “portrait” mode to landscape, the buttons nor navigating the pages get larger. The user needs to “pinch-zoom out” and then the buttons return to the size they were in portrait mode.

IE 8: One column of 17 buttons that span the full page, which is inconsistent with the way the buttons render in iOS 7.

E. Help users recognize, prevent and recover from errors

  1. Does the component help to prevent users from making errors whenever possible?

IE 8: No. Page design and controls do not work properly and cause errors.

iOS 7: There are some possibly minor rendering errors on the page which may cause accessibility issues, but there is no way to “recover” from these errors.

  1. When there is an error, is it simple and informative?

IE 8 &iOS 7: No. There are no error messages; the user quickly will determine that the page is “broken” if in IE 8.

  1. Does it provide information to fix or correct the error?

IE 8 &iOS 7: No. There are no error messages; the user quickly will determine that the page is “broken” if in IE 8.

F. Design for human interaction

  1. When using the component:

a. Is the layout/style intuitive?

IE 8: No. This component does not work with IE 8. Page appears to be broken. Buttons span full width of screen.

iOS 7: The button controls work, but not always as expected. The list of links at the bottom of the page exclude the “room” the user is in. Not sure if this is by design or a coding error.

b. Are the interactions intuitive?

IE 8: No. This component does not work with IE 8.

iOS: Yes. The button controls and links worked as expected (more or less) and I was able to navigate through the site.

  1. Is the layout designed so that various input methods (touch, keyboard, mouse, gesture) and screen sizes can easily interact with things like input fields, sliders and buttons?

IE 8: No. This component is not compatible with IE 8. Formatting of buttons does not work – they span the full page in a vertical stack which is not the intended layout. Also the left and right arrows do not appear and none of the links in the buttons work.

iOS 7: Buttons overlap the text in many cases and do not always work as expected.

  1. If the task can't be completed in one session, does the user have an option to save and return to it at a later time?

N/A

G. Keep it simple

  1. Does the component display only the information needed by the user at any given point in time?

IE 8: No. It tries to link information in the different “rooms” of this virtual museum, but the component is broken and the links do not work.

  1. Overall, are user interactions kept as simple as possible?

IE 8: No. This component does not work with IE 8.

iOS: Yes. The button controls and links worked as expected (more or less) and I was able to navigate through the site.

  1. Does the component use plain language?

N/A

LXP122 commented 10 years ago

CRA has decided not to review this component. Extra reviewer required...

thomasgohard commented 10 years ago

@ivan4 The evaluation you submitted contains only the empty template. Can you submit a completed template.

rubinahaddad commented 10 years ago

@LXP122 , @ivan4 are you able to complete this by Friday?

LXP122 commented 10 years ago

CRA will not be reviewing this component.

From: Rubina Haddad [mailto:notifications@github.com] Sent: January-27-14 2:20 PM To: wet-boew/wet-boew-styleguide Cc: Patterson, Lowell Subject: Re: [wet-boew-styleguide] Heuristic evaluation - Tabbed Interface with slide-horz (#37)

@LXP122https://github.com/LXP122 , @ivan4https://github.com/ivan4 are you able to complete this by Friday?

— Reply to this email directly or view it on GitHubhttps://github.com/wet-boew/wet-boew-styleguide/issues/37#issuecomment-33410357.

ivan4 commented 10 years ago

Apologies. I had to withdraw my incomplete review to date due to timing issues. The spot remains open. Thanks.

nrustand92 commented 10 years ago

A. Please indicate which devices, browsers, and operating systems were tested (Desktop/Mobile/Tablet): Firefox 26 desktop

B. Provide status feedback

  1. Does the component always let users know about its current status? Yes, tab is highlighted if selected
  2. Does the component give immediate, easy to understand feedback? Yes for the tabs. The bottom section (Navigate through the exposition) looked like a part of the slide b/c of the low contrast of the divider. As a suggestion, will a fly-out tab w/ a good contrast help?
  3. Will the user have enough visual cues to easily complete the component’s tasks? Yes
  4. If some part of a component is hidden, can users see something that allows them to bring it in and out of view? Yes

C. Match real world conventions

  1. Do parts of the component match what you see, hear (if any) and touch (if any) meet common expectations and are they easily recognizable? Yes. Previous/Next arrows go in the appropriate direction when clicked. For the purpose of usability testing, perhaps can test if the Previous arrow icon is better to the left of Tab “1.”
  2. When users perform actions within the component, are the results they get what they would commonly expect? Yes

D. Apply standards and ensure consistency

  1. Have industry formatting standards been used consistently throughout? I think so
  2. Is there a logical and consistent usage of elements throughout the component? Yes
  3. Is there a consistent usage of language that is clearly understandable, relevant, concise, current and to the point throughout the component? Yes
  4. Is the experience consistent across screen sizes? No. W/ smaller screen sizes, the tabs occlude the header tabbed interface

E. Help users recognize, prevent and recover from errors

  1. Does the component help to prevent users from making errors whenever possible? Yes. Tabs are clearly and intuitively labeled. Clicking mistakes are easily undone
  2. When there is an error, is the messaging simple and informative? There’s no messaging
  3. Does it provide information to fix or correct the error?

F. Design for human interaction

  1. When using the component:

a. Is the layout intuitive? Yes. For the purpose of usability testing, perhaps can test if the Previous arrow icon is better to the left of Tab “1.” The static bottom section may also be confusing to users (i.e, below the grey dividing line) if it's part of the tabs or not.

b. Are the interactions intuitive? Yes

  1. Is the layout designed so that various input methods (touch, keyboard, mouse, gesture) and screen sizes can easily interact with things like input fields, sliders and buttons? Yes
  2. If the task can't be completed in one session, does the user have an option to save and return to it at a later time? N/A

G. Keep it simple

  1. Does the component display only the information needed by the user at any given point in time? Yes
  2. Overall, are user interactions kept as simple as possible? Yes, but I wonder if 15 tabs are too many
  3. Does the component use plain language? Yes
ballantr commented 10 years ago

A. Please indicate which devices, browsers, and operating systems were tested (Desktop/Mobile/Tablet):

Device OS Browsers
Laptop (24 inch Monitor) Windows 8.1 IE 11.0.3
Laptop (24 inch Monitor) Windows 8.1 FF 27.0.1
Laptop (24 inch Monitor) Windows 8.1 Chrome 33.0.1750.146 m
Nexus 7 Android 4.3 Chrome 33.0.1750.136

Review of the Tabbed Interface with slide-horz #37 as exemplified by http://www.cic.gc.ca/english/games/museum/1.asp

B. Provide status feedback

1. Does the component always let users know about its current status?

Sort of, if you understand what the widget is! And if you can accurately detect the color contrast: image

2. Does the component give immediate, easy to understand feedback?

Yes, clicking causes immediate response.

3. Will the user have enough visual cues to easily complete the component’s tasks?

Probably, though the color contrast may be a bit low for some viewers and some screens.

4. If some part of a component is hidden, can users see something that allows them to bring it in and out of view?

N/A

C. Match real world conventions

1. Do parts of the component match what you see, hear (if any) and touch (if any) meet common expectations and are they easily recognizable?

No.

This widget falls in the cracks between a Paging interface and Tabs, and is not easily recognized as either one.

2. When users perform actions within the component, are the results they get what they would commonly expect?

Yes, once they intuit its meaning.

D. Apply standards and ensure consistency

1. Have industry formatting standards been used consistently throughout?

No.

2. Is there a logical and consistent usage of elements throughout the component?

Not really.

I think some users will “get” the multiple pages idea, but then when the selected “Tab” drops down a pixel, loses its bottom border, and goes white (not the background page color, note), then it becomes sort-of like (but inconsistent with) a tab.

image

Also, having the “Previous / Next” controls at the extreme left is not logical (though no doubt there is some precedent for doing that)

image

Nor is it consistent with the same widget in its narrow format image

3. Is there a consistent usage of language that is clearly understandable, relevant, concise, current and to the point throughout the component?

N/A

4. Is the experience consistent across screen sizes?

No, by design.

The narrow width format works well:

image

The intermediate width format is not acceptable from a visual design standpoint

image

The widget does not scale correctly. As you zoom out the widget gets smaller, but it also behaves as though the browser was narrower (i.e. it starts to wrap)

E. Help users recognize, prevent and recover from errors

1. Does the component help to prevent users from making errors whenever possible?

Yes

2. When there is an error, is the messaging simple and informative?

N/A

3. Does it provide information to fix or correct the error?

Yes

F. Design for human interaction

1. When using the component:

a. Is the layout intuitive?

No. See above

b. Are the interactions intuitive?

Once you “get it”

2. Is the layout designed so that various input methods (touch, keyboard, mouse, gesture) and screen sizes can easily interact with things like input fields, sliders and buttons?

Yes

3. If the task can't be completed in one session, does the user have an option to save and return to it at a later time?

N/A

G. Keep it simple

1. Does the component display only the information needed by the user at any given point in time?

Yes

2. Overall, are user interactions kept as simple as possible?

Yes

3. Does the component use plain language?

N/A

ballantr commented 10 years ago

Summary: Tabbed Interface with slide-horz #37

http://www.cic.gc.ca/english/games/museum/1.asp 17 April, 2014

A. Devices and Browsers Used

Device OS Browsers
HP Desktop, Dell widescreen monitor (1920x1080) windows IE Windows 8.0.7601.17514
iPhone 4 latest iOS 7 “Safari?
Desktop Firefox 26
Laptop (24 inch Monitor) Windows 8.1 IE 11.0.3
Laptop (24 inch Monitor) Windows 8.1 FF 27.0.1
Laptop (24 inch Monitor) Windows 8.1 Chrome 33.0.1750.146 m
Nexus 7 Android 4.3 Chrome 33.0.1750.136
Laptop Windows 7 IE 8.0.7601.17514

B. Overview

The widget seems to have changed between the first two reviews and the third, and most of the issues identified in the first two reviews appear to have been fixed. This “summary” is therefore mostly the highlights of the last review, my own.

Additional reviews are apropos.

C. Bugs Etc.

Win 7 IE 8.0.7601.17514: The page loads with an error. Webpage error details:

User Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0; .NET4.0C; .NET4.0E; .NET CLR 1.1.4322; Tablet PC 2.0; InfoPath.3; CIPA101) Timestamp: Fri, 18 Apr 2014 21:57:49 UTC Message: 'Shortcut' is undefined Line: 3 Char: 213 Code: 0 URI: http://www.cic.gc.ca/scripts/ca.gc.mplg245-jm.js

Message: Script error Line: 0 Char: 0 Code: 0 URI: https://www.google.com/uds/api/search/1.0/ee93f9aae9c9e9dba5eea831d506e69a/default+en.I.js

D. Issues

Unclear model

Messy Wrap

Pervious / Next at Left

rubinahaddad commented 10 years ago

Issue 1 needs to be addressed in the design guide as it’s an implementation issue Issue 3 needs to be tested as suggested.

rubinahaddad commented 10 years ago

Issue 2 needs to be addressed in the design guide as well because it’s an unsupported implementation issue https://github.com/wet-boew/wet-boew/issues/5269