ColorBless: Augmenting Visual Information for Colorblind People - PowerPoint PPT Presentation

National University of Singapore NUS-HCI Lab ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect Soon Hau Chua, Haimo Zhang, Muhammad Hammad, Shengdong Zhao, Sahil Goyal, Karan Singh National University of Singapore, University of Toronto 1

National University of Singapore NUS-HCI Lab ColorBless is a digital colorblind aid that applies binocular luster effect to differentiate confusing colors for colorblind people 2

National University of Singapore NUS-HCI Lab Binocular Luster Effect Visual Illustration of Binocular Luster Effect 3

National University of Singapore NUS-HCI Lab Binocular Luster Effect Video Illustration of Binocular Luster Effect (60fps) 4

National University of Singapore NUS-HCI Lab Binocular Luster Effect • Perception of metallic shininess (shimmering) in binocular vision • Caused by the difference in brightness perceived by left and right eye • Brightness differences > Binocular Fusion Limit • Binocular rivalry effect 5

ColorBless & PatternBless • Introduce colorbless and patternbless

National University of Singapore NUS-HCI Lab 7

National University of Singapore NUS-HCI Lab The Problem for Colorblind • afflicts ~200 million people worldwide (mostly men) • difficulty in differentiating certain confusing colors • Red-green (protanope, deuteranope) and Blue- yellow (tritanope) colourblind 8

National University of Singapore NUS-HCI Lab The Problem for Colorblind • Significance : ~200 million people • Type : 
 Red-green 
 (protanope, deuteranope) 
 Blue-yellow 
 (tritanope) 9

National University of Singapore NUS-HCI Lab The Problem for Colorblind • afflicts ~200 million people worldwide (mostly men) • difficulty in differentiating certain confusing colors • Red-green (protanope, deuteranope) and Blue- yellow (tritanope) colourblind 10

National University of Singapore NUS-HCI Lab Colorblind Techniques • (i) Contextual Inferences • (ii) Substituting Colors • (iii) Augmenting Visual Information 11

National University of Singapore NUS-HCI Lab Contextual Inferences Normal color vision Red-green colourblind 12

National University of Singapore NUS-HCI Lab Contextual Inferences Normal color vision Red-green colourblind 13

National University of Singapore NUS-HCI Lab Substituting Colors Physical Lenses Before After EnChroma Lenses Simulated Effects of X-Chrome Lens 14

National University of Singapore NUS-HCI Lab Substituting Colors Physical Lenses Before After Simulated Effects of X-Chrome Lens 15

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids 16

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids Original Image Colorblind Image Daltonized Daltonized Original Image Colorblind Image Isn’t the color a bit off? Are these still tomatoes? 17

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids Original Image Colorblind Image Daltonized Daltonized Original Image Colorblind Image Isn’t the color a bit off? Are these still tomatoes? 18

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids Original image 19

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids Daltonized Colorblind Image 20

National University of Singapore NUS-HCI Lab Substituting Colors Digital Recoloring Aids Daltonized Colorblind Image 21

National University of Singapore NUS-HCI Lab Augmenting Visual Information Original Image Patterned Colorblind Image Pattern technique by Sajadi et al. (2012) 22

National University of Singapore NUS-HCI Lab Augmenting Visual Information Original Image Patterned Colorblind Image Pattern technique by Sajadi et al. (2012) 23

National University of Singapore NUS-HCI Lab Augmenting Visual Information ColorADD System Transportation Map in Portugal 24

National University of Singapore NUS-HCI Lab Augmenting Visual Information ColorADD System Transportation Map in Portugal 25

National University of Singapore NUS-HCI Lab Augmenting Visual Information Downsides • Introduce unwanted visual artefacts • Disrupt the purpose & aesthetic of images • Learning curve for colourblind people

National University of Singapore NUS-HCI Lab Augmenting Visual Information Downsides • Introduce unwanted visual artefacts • Disrupt the purpose & aesthetic of images • Learning curve for colourblind people

National University of Singapore NUS-HCI Lab Goals of a Good Colorblind Aid • Comfortable to use • The “effect” is noticeable • Confusing colors are easily distinguishable • Does not affect the hues of other non-confusing colors • Does not affect the overall hues for people with normal color vision 28

Scenario • show image meeting with colorblind and normal people • illustrate the downsides of the 3 types of colorblind aid

National University of Singapore NUS-HCI Lab Desirable Properties of a Colorblind Aid • Confusing colors are easily distinguishable • Does not affect the hues of other non-confusing colours • Does not affect the overall hues for people with normal color vision • Comfortable to use 30

ColorBless & PatternBless

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Original Image 32

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Meyer & Greenberg ColorBlind Simulation Algorithm (1998) Simulated Colorblind Image 33

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Find similar colors in colorblind view 34

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Find colors similar in colorblind view, but different in original image 35

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Area to be “blessed” (Applied luster effect) by increasing its brightness (+dY) in one eye and decrease (-dY) in another Apply luster effect to one of the color areas 36

National University of Singapore NUS-HCI Lab ColorBless and PatternBless Bless the whole area Bless with patterns 37

National University of Singapore NUS-HCI Lab ColorBless and PatternBless +dY -dY +dY -dY Bless the whole area Bless with patterns 38

National University of Singapore NUS-HCI Lab User Study Determine color distinguishability and subjective evaluation of ColorBless and PatternBless against existing techniques 39