UX Certification
Get hands-on practice in all the key areas of UX and prepare for the BCS Foundation Certificate.
Many people enjoy behavioural research, whether it's running a usability test, fielding a survey or observing people doing their jobs. Finding things out and making new discoveries excites our natural human curiosity. But when faced with the task of analysing the data behind the research, many people feel their excitement drain away. So how can you overcome a fear of maths to learn how to use statistics?
If you know just one thing about statistics, it will be that statistics is a branch of mathematics. But nowadays, it is actually possible to think of stats as being slightly different from maths. When I learnt how to do data analysis we did it by hand. This meant that you had to be capable of interpreting complex mathematical formulae and perform the relevant statistical analyses. Good mathematical skills were an absolute necessity. However, with the arrival of data analysis programmes such as SPSS, good mathematical skills are no longer needed. If you can add, subtract, divide and multiply, and you are computer literate, you can learn how to do statistical analyses using SPSS.
The key to using SPSS lies not in understanding maths but in understanding research — or more accurately, the statistical concepts underlying research. Learning statistical concepts is no different to learning about any other concepts (such as learning to use the Internet). If you can learn to describe and think about your research using the right concepts and ideas, then using SPSS is quite simple. Of course, you do need to learn where to click to get the various types of stats, and also how to interpret the output, but in this regard SPSS is like any other computer program. This "tool knowledge" is really easy to figure out once you have mastered the key statistical concepts.
So what are the key statistical concepts you have to master in order to be able to use SPSS? There are just three:
Let's look at each of these in turn.
The first key concept is the distinction between an independent and a dependent variable. In an experiment, an independent variable is the variable under the researcher's control. For example, a researcher might ask people to evaluate three alternative designs for a TV remote control. People's reaction to the different designs, as measured by the researcher, is the dependent variable. One way to think of this distinction, especially for researchers who do not do experiments, is to think of dependent variables as outcome measures. In this context, independent variables can be thought of as predictor variables. For example, in a study where researchers are interested in gender differences in choice of product colour, gender is the predictor variable and product colour choice is the outcome measure.
The second key concept is to understand how you are measuring the variables in your study: that is, how you will represent the variables when you enter the data into a spreadsheet. You have three choices:
The first level of measurement is called the nominal scale. Here the numbers mean nothing more than just labels representing categories. For example, when entering data you might code web experience by entering "1" for expert users and "2" for novices. Clearly the numbers here mean nothing more than just labelling.
The second level of measurement is when you simply rank order the results. This is known as the ordinal scale. Here the numbers are an indicator of rank (e.g. which design alternative was ranked first, second or last by participants in a preference test). The major problem with ranking data is that it does not tell us exactly how much better the design ranked first is, in comparison to the design ranked second. It could be twice as good or ten times as good. With ranking information, we know about the order of the designs but we have no information about the size of the intervals between the ranks.
At the third level, variables can be measured using a continuous scale (interval or ratio). This scale is the most refined level of measurement. Here the numbers contain more information and carry a lot more meaning. Continuous measures are good because they not only tell us about order (e.g. which participant completed the test quickest), they also have equal distances between measurement points. So we know that the interval between 10-30 seconds is the same as the difference between 50-70 seconds (i.e. 20 seconds). We can also state with confidence that 70 seconds is longer than 60 seconds and state exactly how much longer it is (i.e. 10 seconds). Examples of continuous scales used in usability tests include time-on-task using seconds, amount of effort as measured by number of mouse clicks, or simply counting the number of negative comments made by the participant.
The final key concept to learn is the notion of study design. There are two major study designs that are often used in research.
The first one is known as the between-participants design or unrelated design. With this approach, the researcher compares two or more separate groups of people. For example, if you run a study comparing domain experts and domain novices, you are using an unrelated design. Similarly, studies comparing people who use Facebook and people who use Bebo can be viewed as using an unrelated design. An experiment comparing a treatment condition with a control condition, with each condition having different people, is also using an unrelated design.
Another popular way to conduct research, especially in the field of usability, is to use the same group of people over and over again to measure different things or to measure the same thing at different time points. This is known as the within-participants design or a related design. For example, a researcher may examine whether there are any differences in usability between a new product and an existing, competitor product. The same people are used to assess the new product and the competitor product.
It is important to note that study design can get more complex, when you have two or more independent variables in the same study. Then you might have a mixed design, with one variable using an unrelated design and another using a related design. For example, you might want to measure differences in usability between two different products, but also compare expert users and novice users with regard to this change. Now you have "experience" being a between-participants variable and "product design" being a within-participants variable.
As long as you understand the basic distinction between unrelated and related designs, it should be easy to describe and understand your own research. The question is simply:
Are you comparing different groups of people, are you using the same people over and over again, or does your study contain both elements?
Once you have mastered the above three key concepts, you are pretty much ready to use SPSS. This is because the various combinations of the above concepts require specific types of data analysis. I will give you three examples.
The list goes on and on. The various permutations of predictor and outcome, type of measure and study design, all have a specific type of analysis you can perform. Your task as a researcher is to first figure out what analyses you should perform, on the basis of your variables, measures and study design. After you have done this, figuring out where to click in SPSS is the easy part. There are books that provide a step by step guide on how to perform any analyses using SPSS (with pictures!) and how to interpret the results. And so it becomes stats not maths. It is simply applying statistical concepts to making data analysis decisions and then clicking on buttons!
Dr. Tendayi Viki (@gtviki on Twitter) is an expert on bringing lean innovation to large companies. He has worked as a consultant for several large organizations including American Express, Standard Bank, Pearson, World Bank, Airbus and The British Museum. He holds a PhD in Psychology and an MBA, and he is the author of two books based on his research and consulting experience, The Corporate Startup and The Lean Product Lifecycle. If you like this article, you'll love his online SPSS training course.
Gain hands-on practice in all the key areas of UX while you prepare for the BCS Foundation Certificate in User Experience. More details
Every month, we share an in-depth article on user experience with over 10,000 newsletter readers. Want in? Sign up now and get free, exclusive access to our reports and eBooks.
For researchers involved in analysing data within their organisation, SPSS Essentials is a 1-day workshop that shows delegates how to use SPSS to input and analyse data and how to interpret and present the results. SPSS Essentials.
Our most recent articles
Let us help you create great customer experiences.
We run regular training courses in usability and UX.
Join our community of UX professionals who get their monthly fix of user experience insights from Userfocus and get free, exclusive access to our reports and eBooks.
copyright © Userfocus 2019.
Get hands-on practice in all the key areas of UX and prepare for the BCS Foundation Certificate.
We can tailor our user research and design courses to address the specific issues facing your development team.
Users don't always know what they want and their opinions can be unreliable — so we help you get behind your users' behaviour.