Exam Instructions

Instructions to Students

Instructions to Students:

This is an open book examination. You may access your notes and online sources. Where you use sources, please include a reference (e.g. a web address) before your answer. You do not need to use a formal referencing method. Note: simply copying material from sources is not acceptable.

This is an individual examination. You must not work with others in any way.

The original time for this examination was 1 hour 30 minutes plus any agreed disability adjustment.

An additional hour is being added to allow for the circumstances.

Answers should be concise and accurate. Marks will be deducted if you include irrelevant or wrong information. Written answers should be typed in a single document. Diagrams may be created using Paint, Visio or other diagramming tool, or hand-drawn and photographed, and inserted into the document.

The time allowed to complete this examination paper is 2 hours 30 minutes.

SECTION 1:  Answer ALL questions.

SECTION 2: Answer 2 questions only (out of the 3 provided)

SECTION 1: Answer ALL questions from this section

a) Which of the following is an expert evaluation method?

· Interview

· Cognitive Walkthrough

· Think-aloud

· Co-discovery

b) How many evaluators does Nielsen recommend to complete a Heuristic Evaluation?

· 3 - 6

· 5 - 7

· 3 - 5

· 5 - 8

c) In a survey, which of the following question types produces ordinal data?

· Likert scale

· Multiple choice

· Yes/No

· Multiple response

d) Which sampling method can be used to split a population into smaller sub-groups?

· Snowball sampling

· Stratified sampling

· Random Sampling

· Systematic Sampling

e) Thematic analysis is used for analysing:

· Quantitative data obtained from quantitative usability testing

· Analytics data provided by analytics software

· Qualitative data obtained from user interviews

· All of the above

Q2. Using ONE of the following areas - give an example of a research study that would be considered legal but IN YOUR OPINION would be unethical, and explain why this is.

· Computer Games

· Social Media

Q3. Explain the concept of a double expert in expert evaluation methodology.

Q4. A study has been carried out with 30 primary school children using the Fun Toolkit to evaluate three games:

· Roblox

· Minecraft

· Lego Worlds

The results are as follows:

Smiley-o-meter (pre and post test) Results

Game	Before Use	After Use
Roblox	4.14	4.14
Minecraft	3.86	4.32
Lego Worlds	3.68	3.24

The question above asked the children how fun they expected the game to be before they played it and then how fun they found it once they had played it. The Smiley-o-meter scale went from 1 (Not Fun) to 5 (Lots of Fun).

AgainAgain Results

Game	Yes	Maybe	No
Roblox	18	7	5
Minecraft	20	8	2
Lego Worlds	16	7	7

The AgainAgain question asked the children to state whether they would play any of the games again.

Fun Sorter Results

	Roblox	Minecraft	Lego Worlds
Most Fun	7	6	17
Easiest to play	14	12	4

The Fun Sorter results show which game the children found most fun and which game they found easiest to play.

Use the data given above to:

· Provide a written summary of the results of this evaluation using the data from all of the tools (Smiley-o-meter, AgainAgain, Fun Sorter). You can use descriptive statistics where appropriate.

· Then discuss the following:

o Any interesting observations you have identified in the data

o How you could improve the results of this study

o What are the limitations of these results (think about the study as a whole, not just the results)

o How could you strengthen the arguments you have presented in your summar?

SECTION 2: Answer 2 questions

Q5. You have been asked by a local supermarket to conduct an observation of people (adults) using their new online e-commerce website.

Think about how you would perform this study and create an information sheet and consent form for participants that will:

· inform the participant of the purpose of the study

· how the study will be conducted (location/tasks etc)

· provide them with the ability to give informed consent to take part

(hint: you will need to think about what data you are going to collect)

Q6. Manchester Airport has just installed a new air traffic control system.  What would be an appropriate evaluation method to identify any potential usability problems with the system?

You will need to:

· Identify an appropriate evaluation method(s)

· Justify why the method(s) chosen is appropriate

· Discuss how you would recruit and select your participants/evaluators

· Explain how the study would be performed (this would be similar to the procedure in an academic paper)

Q7. During the COVID lockdown the use of video conferencing tools such as Skype and Zoom have been a lifeline for people who has been isolating and not able to meet family members and friends in person.

You have been asked to design a questionnaire to evaluate pensioners use of video conferencing systems in the following areas:

· Main technology used

· Main video conferencing platform used

· Positive experiences of the participants

· Issues encountered with the technology or platform(s)

You will need to:

· Design the questionnaire

· Justify the questions asked

Discuss the possible ways of distributing the survey