[PPT] - F&G':&'G,'1,H1,9,#+'G%"+'G,'I#&GJ' PowerPoint Presentation

SLIDE 1

!"#$%"&'()'

*+"+,'-,.'/"0&1"+&1.'&2'3&4#)56,'7,81&9$),#$,'"#:'/,"1#)#4' ;<=>?$=&6,1#';#95+8+,'2&1'(1")#'@,9,"1$%'' (,)A)#4'7&1B"C'D#)6,19)+.E'3%)#"'

F&G':&'G,'1,H1,9,#+'G%"+'G,'I#&GJ'

1

KLMNOMM''' PQ/*R'

SLIDE 2

“moo~”

!"#$%"!

Object knowledge/semantic memory/concepts

2

SLIDE 3

!"#$%&'$%()*$%+'$%,-#$%.'$%/"$%0'$%/1-"#%!-#2$%34556%/"$%0'$%78"$%9'$%7)$%:'$%,-#$%.'$%;"-#2$%9'$%:-1-<-==-$%>'$%:*1?8@$%34556%/"$%0'$%,-#$%.'$%AB)$% ,'$%:-1-<-==-$%>'$%&'(%&8)1*CDEFB'$%344G%

Losing semantic knowledge!

3

! Russian Literature professor in Shanghai 63 year old, left temporal lobe atrophy

“

A kind of animal? Often seen in my

neighbourhood. Long nose, can

accompany me to grocery shopping!

”

Semantic impairment lead to difficulties in language, object recognition, object use!

&)*+!!,-.!

SLIDE 4

Reductionist: to sensory/motor experience

!"#$%&'()$*)"+,-).//0-)1"*)2$3)1$4%'&56

/'0#!1'23+

4567849:;

Whence comes [the mind] by that vast store, which the busy and boundless fancy of man has painted on it with an almost endless variety? ... To this I answer, in one word, From experience. cattle

SLIDE 5

Represented at the sensory/motor sites?

!"#$%& <%=>!

H-1I#%8?%-J'$%5KKL$%AF"8#F8%% ,-)M%8?%-J'$%344N$%&8)1*#%

lick/tongue carry/arm mv 3$23"?+(!=@!

A"<<*#D%8?%-J'$%344G$%:818O%:*1?8@% A"<<*#D%8?%-J'$%345P%&-?%&8)1*DF"%

5

SLIDE 6

Questions: A0)B!$*!C+>C+*+#B+D!)B!B0+!*+#*'CE!*$B+*F!! !G0)>+!'#!@+#BC)?!@$*%)?!>)B0H)E!IJKL&MN!J$*%)?!O'C=)BF! P'H!)C+!D$Q+C+#B!BE>+*!'O!3#'H?+D(+!R'%#D!B'(+B0+CF! !S#)B'=$2)?!)#D!O%#2T'#)?!#+BH'C3*N!C+U+2B!2'##+2T'#*! )2C'**!*+#*'CE"='B'C!*$B+*F!

6

SLIDE 7

Visual pathway

7

.)#H$*0+CV!7:4:W!.C$+(+*3'CB+V!7::XW! Y)CT#V!7::9

SLIDE 8

&+#B+C8Z+C$>0+CE! KC()#$[)T'#!ZC$#2$>?+ !8QE%8?%-J'$%3445 &-D1%8?%-J'$%345N A1"B-D-<%8?%-J'$%345N O)2+ R%$?D$#(*

1

!!" !""#$# !!" !""#%#

KR<+2B*!\!O)2+* X 7 87 8X P+?@+T2) L+BC$* &)CB''#!O)2+* Y'#3+E!O)2+*

Reflect visual properties

+2T?$#+)C!@*]!-'%#D

1'H8?+@+?!J$*%)?!^+)B%C+!ZC$#2$>?+

! G2+#+8-+2T?$#+)C!G+#*$T@+#+**! ! S#$=)B+8&%C@+!G+#*$T@+#+**!

8

SLIDE 9

But similar selectivity without visual experience

S=+D$!+B!)?]V!7::9V!! _)B!_+%C'*2$! KR<+2B*! 1KB@! Y)0'#!+B!)?]V!7::`V! _+%C'#! S#$)=B+" $#)#$=)B+! Y+D^aW1 K&! A'?R+C*!+B!)?]V!7:44V!! &%CC!b$'?! 1+('!*2+#+! ZZS!

+$20!+B!)?]V!7:44V!

&%CC!b$'?! bC)$??+! JA^S! GBC$+=8S=$B!+B!)?]V! 7:47V!_+%C'#! 1+c+C!*0)>+*! RE!GGd JA^S! GBC$+=8S=$B!e! S=+D$V!7:4;V!&%CC! b$'?! b'DE!

$(0B!fbS!

7$)$*)"+,-)./89-) 1$4%':;"<$) !-128%*OR% !!=) !$$+$()$*)"+,-)./89-) >'?1) ?**JD% @AB?)

! G'=+!0$(0+C!'CD+C!JKL&!C+($'#!O%#2T'#!I2)B+('C$2)?!>C+O+C+#2+*M!$*! $#D+>+#D+#B!'O!@$*%)?!+g>+C$+#2+!

9

!

1)C(+!'R<+2B* L''?* S#$=)?*

SLIDE 10

Function and connection: Congenitally blind vs. Sighted

Blind =/= sighted "

Shaped by visual input

Blind = sighted "

Not fully dependent on visual input Measure 2: Resting-state functional connectivity pattern Vector 1-180 Measure 1: Task induced activation level to 16 object categories: human face parts, human body parts, daily scenes, tools, mammals, reptiles, birds, fishes, bugs, fruits and vegetables, flowers, preserved food, clothes, musical instruments, vehicles, furniture

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

10

SLIDE 11

Function and connection: Congenitally blind vs. Sighted

11

L)*3!$#D%2+D!)2T@)T'#! ?+@+?!B'!45!'R<+2B! 2)B+('C$+*N!!

+*T#(8*B)B+!O%#2T'#)?!

2'##+2T@$BE!>)c+C#!

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

SLIDE 12

Correspondence between connectional and functional fingerprints across VOTC

G^&!>)c+C#!*$=$?)C$BE!=)>

L)*3!)2T@)T'#!*$=$?)C$BE!=)>

12

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

SLIDE 13

“Multi-modal” region1: anterior medial temporal

13

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

SLIDE 14

“Multi-modal” region1: anterior medial temporal

14

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

SLIDE 15

“Visual” regions

15

C"(<-)!$$+$(-)7"(-)7$-)?"%";"DD"-)E)F6-)./8G-)>)1$4%'&56)

SLIDE 16

H%6++IJK$5*'%-)L,-)E)C$6($%-)L,J,-)./8M-)1"*)2$3)1$4%'&56)

! 1$#3$#(!)#)B'=$2)?!O+)B%C+*!B'!?)C(+8*2)?+!O%#2T'#)?!

=)>*!$#!B0+!@+#BC)?!B+=>'C)?!2'CB+g!

16

SLIDE 17

SLIDE 18

JKL&

Q#)B"+,' Q152"$+'

Y'C+!BC)#*>)C+#B!=)>>$#(! H$B0!)2T'#"O%#2T'#!C+>C! +)*$?E!)22+**+D!RE!D$Q! ='D)?$T+*! Y'C+!h=%?T='D)?i!

F6)N,-)C"(<)O,)E)?"%";"DD")=,-)./8P-)B%$(Q&)?'<)J56))

Y'C+!h$*'?)B+Di!OC'=!! #'#@$*%)?!>C'>+CT+*! ! ! Y'C+!h@$*%)?i!

Review

Object Domain and Modality in the Ventral Visual Pathway

Yanchao Bi,1,* Xiaoying Wang,1 and Alfonso Caramazza2,3

The nature of domain-specific organization in higher-order visual cortex (ventral

ccipital temporal cortex, VOTC) has been investigated both in the case of visual

Trends

A wave of recent studies has reported

SLIDE 19

Q152"$+'

Y'C+!BC)#*>)C+#B!=)>>$#(! H$B0!)2T'#"O%#2T'#!C+>C! +)*$?E!)22+**+D!RE!D$Q! ='D)?$T+*! Y'C+!h=%?T='D)?i!

F6)N,-)C"(<)O,)E)?"%";"DD")=,-)./8P-)B%$(Q&)?'<)J56)) P'H!2)#!H+!B+*B!$BF! ! 88!$*!*0)>+!C+>C+*+#B)T'#! 0+C+!O'C!)CTO)2B*!BC%?E! =%?T8='D)?F! ! 88!$*!'%C!>+C2+>T'#!*0)>+*! RE!'%C!h)CTO)2Bi8?$3+!)2T'#! $#B+C)2T'#F

SLIDE 20

! L0+!j%+*T'#!H)*!'C$($#)??E!>'*+D!B'!1'23+!RE!>0$?'*'>0+C!A$??$)=!Y'?E#+%gV! H0'*+!H$O+!H)*!R?$#DN!

Suppose a man born blind, and now adult, and

taught by his touch to distinguish between a cube and a sphere of the same metal, and nighly of the same bigness, so as to tell, when he felt one and the other, which is the cube, which is the sphere. Suppose then the cube and the sphere placed on a table, and the blind man made to see: query, Whether by his sight, before he touched them, he could now distinguish and tell which is the globe, which the cube?

!"#$%&'()*+&',-'.//01'2"-#%3-4-5'6780-'9-:%3/;0-:4-5&&

“ ”

Molyneux’s problem

20

SLIDE 21

21

SLIDE 22

Testing the shape knowledge explicitly!

SLIDE 23

Method ! Participants

– Sighted visual (12 good Ss, picture input) – Sighted auditory (14 good Ss, word input) – Blind auditory (13 good Ss, word input)

! Task

!Hear object name (e.g. “key”) – judge is it larger or smaller than an average palm? ER design: 8 runs. Each stimulus repeated twice each run.

! Ratings

– Pixel similarity – Shape similarity – Tactile similarity – (checked both colledge Ss ratings and fMRI Ss ratings. Results were similar.

Here report results with colledge Ss ratings)

! Materials

– 33 everyday artifacts

SLIDE 24

Shape similarity ratings

@'0,+G,,#'9%"H,'"#:'+"$5C,S'OLL'

0.88** 0.84** 0.84**

24

k#D+>+#D+#B!C)T#(!

S88J8#$%,8$%,-#$%:-1-<-==-$%/"$%345N$%;%&8)1*DF"%

Artifact “multimodal” shape representation

SLIDE 25

IT: [Multi-modal] Shape knowledge in blind and sighted

kL!

25

+>C+*+#B)T'#!*$=$?)C$BE!

)#)?E*$*!! I.C$+(+*3'CB+!+B!)?]V!7::XM!

S88J8#$%,8$%,-#$%:-1-<-==-$%/"$%345N$%;%&8)1*DF"%

SLIDE 26

J$D+'!A)B20$#( Y)#$>%?)B+! !I*=)??!)CTO)2BM _)@$()T'#! I?)C(+!'R<"! 1)#D=)C3M G'2$)?! IO)2+M

Learning: Association with different types of interactions

aC)>0!J$+H$#(

0-#2$%,8T%8?%-J'$%"#%C18C 26

SLIDE 27

Y)#$>%?)T'#!! \!_)@$()T'#!l!G'2$)? 1KL&

+($'#*!*0'H$#(!*+?+2T@$BE!B'!*>+2$m2!0%=)#8'R<+2B!$#B+C)2T'#!

=)##+C*!

0-#2$%,8%8?%-J'$%U#%S18C

_)@$()T'#!! \!G'2$)?lY)#$>%?)T'# G'2$)?!\!_)@$()T'#!l! Y)#$>%?)T'# ZZS ZZS _'!JKL&

27

k#B+C+*T#(!'#!$B*!'H#]

SLIDE 28

0-#2$%,8%8?%-J'$%U#%S18C

Sn+C!BC)$#$#(o

C*?=TC/UV3'W3*':81)#4'B"#)H8C"5&#'6):,&TG"+$%)#4

)#+,1"$5&# @'X'LOYLE'H'Z'LOLM'

8p!! 8;!! 86!! 87!! 84!! :!! 4!! 7!! 6!! ;!! p!! 8:];:!! 8:]7:!! :]::!! :]7:!! :];:!! :]5:!! :]X:!!

0-#2$%,8%8?%-J'$%U#%S18C

1KL&!)2T@)T'#!&'CC+?)B+D!H$B0!! ?GYa8?1KL&!^&G 1KL&!)2T@)T'#!&'CC+?)B+D!H$B0!! h*=)??!)CTO)2B*i!C+2)??!)22%C)2E

6
4
2

2 4 6 0.6 0.8 1 @'X'LOYKE'H'Z'LOLM'' )#+,1"$5&#

*B"CC'&0A,$+'1,$"CC'"$$81"$.

GYa 1KL&

28

b+B)!20)#(+ b+B)!20)#(+

SLIDE 29

A0)B!$*!C+>C+*+#B+D!)B!B0+!*+#*'CE!*$B+*F!! !G0)>+!'#!@+#BC)?!@$*%)?!>)B0H)E!IJKL&MN!J$*%)?!O'C=)BF! P'H!)C+!D$Q+C+#B!BE>+*!'O!3#'H?+D(+!R'%#D!B'(+B0+CF!

29

qfG!O'C!)#$=)?*W!_K!O'C!)CTO)2B*!I+@'?%T'#)C$?E! >C'(C)==+D!B'!=)>!H$B0!O%#2T'#M!

SLIDE 30

&'#2+>B*!R+E'#D!JKL&!

/"#V81%8?%-J'$%344K$%:818O1-J%:*1?8@% >%H8?-W-#-JED"D%*X%534%XHYU%D?)V"8D%*X%D8<-#IF%C1*F8DD"#2%

30

P'H!)C+!B0+E!2'##+2B+DF!ZC+D$2T'#*F! A'%?D!B0+!2'##+2T'#!>)c+C#!C+U+2B!B0+!R$#D$#(!)2C'**!='D)?$T+*F

SLIDE 31

Structural connections supporting object concept

?

,-#$%.'$%H-$%0'$%(*#2$%('$%,8$%0'$%:-1-<-==-$%>'$%/"$%0'$%345P'%/1-"#%

! White matter tract integrity in 87 patients with brain damage

Picture associative matching Sound naming Picture naming

!

SLIDE 32

Structural connections for object concept

Lesion volume Mean FA Thalamas-IFG IFG, pSTG/MTG, SPL/ IPL/FFG/OECT/ DLPFC! Temporal lobe-IFG

,-#$%.'$%H-$%0'$%(*#2$%('$%,8$%0'$%:-1-<-==-$%>'$%/"$%0'$%345P'%/1-"#%

SLIDE 33

Functional connections for object concepts

Resting-state fMRI

Picture associative matching Sound naming Picture naming

pMTG 78"$%9'$%!"-#2$%Z'$%,8$%0'$%.-#2$%0'$%,-#$%.'$%:-1-<-==-$%>'$%/"$%0'$%3453'%%;'%&8)1*DF"'%

SLIDE 34

L0+!AY!2'##+2T'#*!H$B0!*>+2$m2!+#D!#'D+*!

R"(<-)$*)"+,-)./8G-)74;)F%"6()S"KK)

! &'#*BC%2B+D!$#!;9!0+)?B0E!2'#BC'?*W!

!!!!!&'CC+?)B+D!H$B0!*+=)#T2!D+m2$B*!$#! !!!!!X:!>)T+#B*N!

! S#)B'=$2)?!Y'D%?+*N!

SLIDE 35

k#BC$#*$2!IC+*T#(!*B)B+M!O%#2T'#)?!2'##+2T@$BE!

O4-)@6(-)7"(-)7$)E)F6-)./8P-)1$4%':;"<$) _+BH'C3!&'##+2T@$BE _+BH'C3!Y'D%?+* _+BH'C3!P%R*

_r4;9

SLIDE 36

O4-)@6(-)7"(-)7$)E)F6-)./8P-)1$4%':;"<$)

SLIDE 37

S!BC$8#+BH'C3!='D+?!'O!*+=)#T2!>C'2+**$#(!

*,B"#5$'3&#+1&C' [/,\'W]7^ ?8C5B&:"C',_H,1),#$)"C' [<?7^ 9.B0&C)$'1,H1,9,#+"5&#' [/,\']*7^

Q=' ?W=>*W= QV/

H?V= H;]*

37

O4-)7$)E)F6-):()2$36&6'()

SLIDE 38

S!BC$8#+BH'C3!='D+?!'O!*+=)#T2!>C'2+**$#(!

38

C"(<)$*)"+,-):()K%$K)

65:!)R*BC)2B!H'CD*!! 8!1)#(%)(+!2'C>%*!R)*+D!D$*B)#2+!*>)2+

SLIDE 39

P'H!)C+!D$Q+C+#B!BE>+*!'O!3#'H?+D(+!R'%#D!B'(+B0+CF!

39

&'##+2T@$BE!>)c+C#!C+@+)?*!B0C++!='D%?+*N! =%?T='D)?!+g>+C$+#T)?V!*E=R'?$2V!)#D!2'#BC'?! #+BH'C3*!

SLIDE 40

&'#2?%$'#!

40

8!Y'D)?$BE8*>+2$m2! +g>+C$+#2+!C+>C+*+#B)T'#*! 8!b$#D$#(!'O!B0+*+! C+>C+*+#B)T'# 8!fg>+C$+#2+8R)*+D!g!d'=)$#! 8!&'#B)$#*!#+BH'C3*!C+?)B+D!! B'!+g>+C$+#2+V!B'!*E=R'?$2! I?)#()%(+MV!)#D!2'#BC'?

SLIDE 41

Acknowledgment

Xiaoying Wang Xiaosha Wang Yuxing Fang Yangwen Xu Chenxi He

Collaborators

Alfonso Caramazza, Harvard/CiMec Italy Marius Peelen, CiMec, Italy Yong He, BNU Gaolang Gong, BNU

Funding agencies

National Natural Science Foundation China 973 program, Ministry of Science and Techonology, China Beijing Natural Science Foundation

41

3&#$,H+'/"0'"+'(7D

SLIDE 42

L0)#3!E'%！

! ! !

+2C%$B*!(''D!Z'*BD'2*!)#D!Z0d!*B%D+#B*!

! yR$sR#%]+D%]2#!

42

!"#$%"!

“

”

!

“ ”

?

&'#2?%*$'#*!

L0)#3!E'%！

&'#2?%$'#!