t pr r r t r

t Prr r t r - PowerPoint PPT Presentation

t Prr r t r t t ss


  1. ❊✣❝✐❡♥t Pr♦❣r❛♠♠❛❜❧❡ ▲❡❛r♥✐♥❣ t♦ ❙❡❛r❝❤ ❲✐t❤ ❍❛❧ ❉❛✉♠❡✱ ❛♥❞ ❙t❡♣❤❛♥❡ ❘♦ss ❤tt♣✿✴✴❛r①✐✈✳♦r❣✴❛❜s✴✶✹✵✻✳✶✽✸✼ ■❈▼▲ ❲♦r❦s❤♦♣ ♦♥ ◆❡✇ ▲❡❛r♥✐♥❣ ❋r❛♠❡✇♦r❦s ❛♥❞ ▼♦❞❡❧s ❢♦r ❇✐❣ ❉❛t❛ ❏✉♥❡ ✷✺✱ ✷✵✶✹

  2. ❊①❛♠♣❧❡✿ P❛rt ♦❢ ❙♣❡❡❝❤ ❚❛❣❣✐♥❣ P✐❡rr❡ ❱✐♥❦❡♥ ✱ ✻✶ ②❡❛rs ♦❧❞ Pr♦♣❡r ◆✳ Pr♦♣❡r ◆✳ ❈♦♠♠❛ ◆✉♠❜❡r ◆♦✉♥ ❆❞❥✳ ❙tr✉❝t✉r❡❞ Pr❡❞✐❝t✐♦♥ ❂ ❥♦✐♥t ♣r❡❞✐❝t✐♦♥ ✇✐t❤ ❛ ❥♦✐♥t ❧♦ss

  3. ❙tr✉❝t✉r❡❞ Pr❡❞✐❝t✐♦♥ ❂ ❥♦✐♥t ♣r❡❞✐❝t✐♦♥ ✇✐t❤ ❛ ❥♦✐♥t ❧♦ss ❊①❛♠♣❧❡✿ P❛rt ♦❢ ❙♣❡❡❝❤ ❚❛❣❣✐♥❣ P✐❡rr❡ ❱✐♥❦❡♥ ✱ ✻✶ ②❡❛rs ♦❧❞ Pr♦♣❡r ◆✳ Pr♦♣❡r ◆✳ ❈♦♠♠❛ ◆✉♠❜❡r ◆♦✉♥ ❆❞❥✳

  4. ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳

  5. ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳

  6. ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳

  7. ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝② ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳

  8. ❍♦✇ ❝❛♥ ②♦✉ ❜❡st ❞♦ str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥❄ ❲❡ ❝❛r❡ ❛❜♦✉t✿ ✶✳ Pr♦❣r❛♠♠✐♥❣ ❝♦♠♣❧❡①✐t②✳ ▼♦st str✉❝t✉r❡❞ ♣r❡❞✐❝t✐♦♥s ❛r❡ ♥♦t ❛❞❞r❡ss❡❞ ✇✐t❤ str✉❝t✉r❡❞ ❧❡❛r♥✐❣♥ ❛❧❣♦r✐t❤♠s✱ ❜❡❝❛✉s❡ ✐t ✐t t♦♦ ❝♦♠♣❧❡① t♦ ❞♦ s♦✳ ✷✳ Pr❡❞✐❝t✐♦♥ ❛❝❝✉r❛❝②✳ ■t ❤❛❞ ❜❡tt❡r ✇♦r❦ ✇❡❧❧✳ ✸✳ ❚r❛✐♥ s♣❡❡❞✳ ❉❡❜✉❣✴❞❡✈❡❧♦♣♠❡♥t ♣r♦❞✉❝t✐✈✐t② ✰ ♠❛①✐♠✉♠ ❞❛t❛ ✐♥♣✉t✳ ✹✳ ❚❡st s♣❡❡❞✳ ❆♣♣❧✐❝❛t✐♦♥ ❡✣❝✐❡♥❝②

  9. ❆ ♣r♦❣r❛♠ ❝♦♠♣❧❡①✐t② ❝♦♠♣❛r✐s♦♥ 1000 lines of code for POS 100 10 1 CRFSGD CRF++ S-SVM Search

  10. Part of speech tagging (tuned hps) 0.98 96.6 96.1 96.1 0.96 95.8 95.7 95.7 95.0 Accuracy (per tag) 0.94 0.92 VW Search VW Search (own fts) 90.7 VW Classification CRF SGD 0.90 CRF++ Str. Perceptron Structured SVM 1m 10m 30m 1h Str.SVM (DEMI-DCD) 0.88 10 0 10 1 10 2 10 3 Training Time (minutes)

  11. Prediction (test-time) Speed VW Search VW Search (own fts) POS 13 CRF SGD 5.7 129 CRF++ 133 Str. Perceptron 5.3 Structured SVM 14 5.6 NER Str. SVM (DEMI-DCD) 98 24 218 285 0 50 100 150 200 250 300 Thousands of Tokens per Second

  12. ❆♥ ♦✉t❧✐♥❡ ✶✳ ❍♦✇❄ ✶✳✶ Pr♦❣r❛♠♠✐♥❣ ✶✳✷ ▲❡❛r♥✐♥❣ t♦ ❙❡❛r❝❤ ✶✳✸ ❊q✉✐✈❛❧❡♥❝❡ ✶✳✹ ❖♣t✐♠✐③❛t✐♦♥s ✷✳ ❖t❤❡r ❘❡s✉❧ts

  13. ■♥ ❡ss❡♥❝❡✱ ✇r✐t❡ t❤❡ ❞❡❝♦❞❡r✱ ♣r♦✈✐❞✐♥❣ ❛ ❧✐tt❧❡ ❜✐t ♦❢ s✐❞❡ ✐♥❢♦r♠❛t✐♦♥ ❢♦r tr❛✐♥✐♥❣✳ ❍♦✇ ❞♦ ②♦✉ ♣r♦❣r❛♠❄ ❙❡q✉❡♥t✐❛❧❴❘❯◆✭ ❡①❛♠♣❧❡s ✮ ✶✿ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♣r❡❞✐❝t✐♦♥ ← ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ✷✿ ✐❢ ♦✉t♣✉t ✳ ❣♦♦❞ t❤❡♥ ✸✿ ♦✉t♣✉t ✓ ✬ ✬ ✓ ♣r❡❞✐❝t✐♦♥ ✹✿ ❡♥❞ ✐❢ ✺✿ ✻✿ ❡♥❞ ❢♦r

  14. ❍♦✇ ❞♦ ②♦✉ ♣r♦❣r❛♠❄ ❙❡q✉❡♥t✐❛❧❴❘❯◆✭ ❡①❛♠♣❧❡s ✮ ✶✿ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♣r❡❞✐❝t✐♦♥ ← ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ✷✿ ✐❢ ♦✉t♣✉t ✳ ❣♦♦❞ t❤❡♥ ✸✿ ♦✉t♣✉t ✓ ✬ ✬ ✓ ♣r❡❞✐❝t✐♦♥ ✹✿ ❡♥❞ ✐❢ ✺✿ ✻✿ ❡♥❞ ❢♦r ■♥ ❡ss❡♥❝❡✱ ✇r✐t❡ t❤❡ ❞❡❝♦❞❡r✱ ♣r♦✈✐❞✐♥❣ ❛ ❧✐tt❧❡ ❜✐t ♦❢ s✐❞❡ ✐♥❢♦r♠❛t✐♦♥ ❢♦r tr❛✐♥✐♥❣✳

  15. ❙❡q❴❉❡t❡❝t✐♦♥✭ ❡①❛♠♣❧❡s ✱ ❢❛❧s❡❴♥❡❣❛t✐✈❡❴❧♦ss ✮ ▲❡t ♠❛①❴❧❛❜❡❧ ❂ ✶✱ ♠❛①❴♣r❡❞✐❝t✐♦♥ ❂ ✶ ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♠❛①❴❧❛❜❡❧ ← ♠❛①✭ ♠❛①❴❧❛❜❡❧ ✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮ ❡♥❞ ❢♦r ❢♦r ✐ = ✶ t♦ ❧❡♥✭ ❡①❛♠♣❧❡s ✮ ❞♦ ♠❛①❴♣r❡❞✐❝t✐♦♥ ← ♠❛①✭ ♠❛①❴♣r❡❞✐❝t✐♦♥ ✱ ♣r❡❞✐❝t✭ ❡①❛♠♣❧❡s ❬ ✐ ❪✱ ❡①❛♠♣❧❡s ❬ ✐ ❪ ✳ ❧❛❜❡❧ ✮✮ ❡♥❞ ❢♦r ✐❢ ♠❛①❴❧❛❜❡❧ ❃ ♠❛①❴♣r❡❞✐❝t✐♦♥ t❤❡♥ ❧♦ss✭ ❢❛❧s❡❴♥❡❣❛t✐✈❡❴❧♦ss ✮ ❡❧s❡ ✐❢ ♠❛①❴❧❛❜❡❧ ❁ ♠❛①❴♣r❡❞✐❝t✐♦♥ t❤❡♥ ❧♦ss✭✶✮ ❡❧s❡ ❧♦ss✭✵✮ ❡♥❞ ✐❢ ❡♥❞ ✐❢

Recommend


More recommend


Explore More Topics

Stay informed with curated content and fresh updates.