Using biometric gadgets for express-tests in the UX/UI research - - PowerPoint PPT Presentation

Using biometric gadgets for express-tests in the UX/UI research

Dmitriy Kostiuk, Anastasia Markina, Alexandr Dubitsky

Biometrics in usability

• Biometric measuring tools have recently

undergone a new wave of attention in the usability researches

• New powerful user-grade measuring gadgets

are the reason

– Mass-market production for the entertainment and

fitness applications made them much cheaper

– The precision they provide for contemporary games

can be a valuable addition for the UX research

Scheme of Testing

• A User is typing the text, moving mouse, etc.
• Time and errors are taken into account
• Heart rate is measured by a fitness tracker
• Attention level and gaze direction, etc.

are estimated by a consumer-grade devices: EEG, eye tracker, etc.

Available biometric parameters to measure

• Galvanic skin response
• Heart rate
• Blood pressure
• Electroencephalography waves (EEG)
• Kinematic activity
• Gaze direction

What we have used?

• EEG:

– NeuroSky MindWave – NeuroSky MindSet – Emotiv EPOC/EPOC+ – Emotiv Insight

• Fitness-trackers:

– Fibit Charge HR – Xiaomi Mi Band 2/3 – Amazfit Bip

• Tobii eye-trackers

Testing schemes

Parallel testing mode

Measured data stored in a database

logs archive

Individual testing mode

logs archive logs archive logs archive

Measured data stored in a database Our own UXDump project bitbucket.org/AsyaAliset/uxdump

• r some shell script to run the data acquisition software in parallel

Heart rate, EEG

How to get data from device

• Using universal API

– Bluez/QtBluetooth, etc.

• API from the device vendor

– Fitbit web API – Tobii SDK – Special licenses to process personal data are possible

• Special open source tools per device

– Mindwave (EEG) – PuzzleBox Synapse project – … a lot more

• File abstraction

– Garmin fitness trackers pretend to be just a flash drive with logs

If the gadget does not provide biometrics data (especially in realtime) by itself, the open source may come into the deal If the gadget does not provide biometrics data (especially in realtime) by itself, the open source may come into the deal

Getting heart rate with the remote access API ...

Fitbit HR (pulse) DB Fitbit.com galileo tool Launcher, ……. Testing PC cyphered data sent to web Decyphered data in JSON

• … may be ridiculously complicated:

Evaluation criteria

• duration of the given actions
• number of errors
• heart rate
• attention level

– calculated based on beta to alpha waves ratio – pre-calculated metrics (like «Attention» by NeuroSky)

are good enough for practical needs

• emotions?

Gaze detection

This allows to calculate the ratio between gaze fixations

• n the
• bject of

interest (e.g. tools panel) and the irrelevant areas GNU octave turned out to be the easiest tool to plot gaze movements and gaze heatmaps

Gaze tracking heatmaps: Same task executed by six users

Heatmaps in GNU octave:

Two types of test tasks

• Series of different type operations in one program

– user is supplied with a set of tasks under one general

thematic direction

• e.g. the working with a word processor

– assess how the overall layout and dynamics of the

application interface affect the user

• Long sequence of routine operations

– large amount of the same type tasks – each task involves several applications, or parts – evaluate the contribution of the GUI auxiliary elements

Tests example (office interfaces)

Office interfaces / Results

Office interfaces / Results

max. HR,% max. GSR,% Users who work best with ribbons Users who work best with top panel

Tests / Keyboards

Hardware keyboard by Asus Onboard from Ubuntu 16.04 Default AOSP Keyboard from Android-x86

Keyboards / Results

Hardware keyboard Onboard (Ubuntu) AOSP Keyboard (Android) speed, chars/s mind concentration, a.u. pulse, beats/min errors, %

Conclusions

• Consumer-grade biometrics turned out to be enough mature to be

used in the UI/UX comparison

– There are enough open source friendly devices on the mass market

• Biometric indicators are really useful in practical evaluation of the

humans physical and mental load

– Based on the test results, the average values for the listed parameters

and the maximum deviation of the parameter from the average component can be easily calculated

• Each of the presented criteria allows to reduce the time series to a

single value

– This value reflects the nature of the work of a specific user in a particular

test