Why Transformers Work. More info blablabla More info blablabla - - PowerPoint PPT Presentation

▶

Why Transformers Work. *More info blablabla *More info blablabla - - PowerPoint PPT Presentation

Sep 18, 2022 330 likes •1.11k views

Why Transformers Work. *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More info blablabla *More

SLIDE 1

Why Transformers Work.

SLIDE 2

*More info blablabla

SLIDE 3

*More info blablabla

SLIDE 4

*More info blablabla

SLIDE 5

*More info blablabla

SLIDE 6

*More info blablabla

SLIDE 7

*More info blablabla

SLIDE 8

*More info blablabla

SLIDE 9

*More info blablabla

SLIDE 10

*More info blablabla

SLIDE 11

*More info blablabla

SLIDE 12

*More info blablabla

SLIDE 13

*More info blablabla

SLIDE 14

*More info blablabla

SLIDE 15

*More info blablabla

SLIDE 16

*More info blablabla

SLIDE 17

*More info blablabla

SLIDE 18

*More info blablabla

SLIDE 19

*More info blablabla

SLIDE 20

*More info blablabla

SLIDE 21

*More info blablabla

SLIDE 22

*More info blablabla

SLIDE 23

*More info blablabla

SLIDE 24

*More info blablabla

SLIDE 25

*More info blablabla

SLIDE 26

*More info blablabla

SLIDE 27

*More info blablabla

SLIDE 28

*More info blablabla

SLIDE 29

*More info blablabla

SLIDE 30

*More info blablabla

SLIDE 31

*More info blablabla

SLIDE 32

*More info blablabla

SLIDE 33

*More info blablabla

SLIDE 34

*More info blablabla

SLIDE 35

*More info blablabla

SLIDE 36

*More info blablabla

SLIDE 37

*More info blablabla

SLIDE 38

*More info blablabla

SLIDE 39

SLIDE 40

SLIDE 41

SLIDE 42

SLIDE 43

SLIDE 44

SLIDE 45

SLIDE 46

SLIDE 47

SLIDE 48

*More info blablabla

SLIDE 49

*More info blablabla

SLIDE 50

*More info blablabla

SLIDE 51

*More info blablabla

SLIDE 52

*More info blablabla

SLIDE 53

*More info blablabla

SLIDE 54

*More info blablabla

SLIDE 55

*More info blablabla

SLIDE 56

*More info blablabla

SLIDE 57

*More info blablabla

SLIDE 58

*More info blablabla

SLIDE 59

*More info blablabla

SLIDE 60

*More info blablabla

SLIDE 61

config.yml policies:

name: MemoizationPolicy
name: TEDPolicy

epochs: 200 max_history: 1

name: MappingPolicy

*More info blablabla

Your input -> start counting Countdown! ETA 10 🎶 Your input -> ok Countdown! ETA 5 🎶 Your input -> ok Countdown! ETA 5 🎶 Your input -> ok Countdown! ETA 5 🎶 Your input -> ok Countdown! ETA 5 🎶

SLIDE 62

config.yml policies:

name: MemoizationPolicy
name: TEDPolicy

epochs: 200 max_history: 3

name: MappingPolicy

*More info blablabla

Your input -> count Countdown! ETA 10 🎶 Your input -> ok Countdown! ETA 9 🎶 Your input -> ok Countdown! ETA 8 🎶 Your input -> ok Countdown! ETA 7 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 6 🎶 Your input -> ok Countdown! ETA 5 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Your input -> Countdown! ETA 10 🎶

SLIDE 63

config.yml policies:

name: MemoizationPolicy
name: TEDPolicy

epochs: 200 max_history: 10

name: MappingPolicy

*More info blablabla

Your input -> count Countdown! ETA 10 🎶 Your input -> ok Countdown! ETA 9 🎶 Your input -> ok Countdown! ETA 8 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 7 🎶 Your input -> ok Countdown! ETA 6 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 5 🎶 Your input -> ok Countdown! ETA 4 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 3 🎶 Your input -> ok Countdown! ETA 2 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 1 🎶 Your input -> ok End of countdown!

SLIDE 64

config.yml Using LSTM policies:

name: MemoizationPolicy
name: KerasPolicy

epochs: 200

name: MappingPolicy

*More info blablabla

Your input -> count Countdown! ETA 10 🎶 Your input -> ok Countdown! ETA 9 🎶 Your input -> ok Countdown! ETA 8 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 7 🎶 Your input -> are you a bot I am a bot, not a human, powered by Rasa. Countdown! ETA 6 🎶 Your input -> are you a bot? Countdown! ETA 5 🎶 Your input -> ok Countdown! ETA 4 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa. Countdown! ETA 3 🎶 Your input -> are you a bot? I am a bot, not a human, powered by Rasa.

SLIDE 65

The real problem though.

SLIDE 66

While I have you here: check the Rasa Algorithm Whiteboard! Our algorithms are explained in more detail! I also take requests for content.

SLIDE 67

While I have you here: check out WHATLIES It’s an open source package for visualising word embeddings. Soon: features for detecting bias. Feedback is appreciated!

rig_chart = emb.plot_interactive('man', 'woman')

new_ts = emb | (emb['king'] - emb['queen']) new_chart = new_ts.plot_interactive('man', 'woman')

SLIDE 68

Vincent D. Warmerdam Research Advocate v.warmerdam@rasa.com

Rasa Technologies GmbH, Schönhauser Allee 175, 10119 Berlin, Germany

Get in touch!

SLIDE 69

Vincent D. Warmerdam Research Advocate v.warmerdam@rasa.com

Rasa Technologies GmbH, Schönhauser Allee 175, 10119 Berlin, Germany

Appendix

SLIDE 70

*More info blablabla

SLIDE 71

*More info blablabla

SLIDE 72

*More info blablabla

SLIDE 73

*More info blablabla

SLIDE 74

*More info blablabla

SLIDE 75

*More info blablabla

SLIDE 76

*More info blablabla

SLIDE 77

*More info blablabla

We use this encoder bit.