Multi Language Support for Virtual Assistants Prise en charge - PowerPoint PPT Presentation

Multi Language Support for Virtual Assistants Prise en charge multilingue pour les assistants virtuels 对 虚 拟 助手的多 语 言支持 یزاجم نارایتسد یارب هنابز دنچ ینابیتشپ Supporto multilingue per assistenti virtuali 仮想アシスタントの多言語サポート Soporte multilenguaje para asistentes virtuales वरॎचुअल असिसॎटेःट क े सलए मलॎटी लैःगॎवेज िपोटु 가상 어시스턴트를위한 다국어 지원 Suporte em vários idiomas para assistentes virtuais April 2020

Overview

Overview Goals: • Extending the current capabilities of Almond to other languages in a cost and time efficient manner • Avoiding template development for each new language

Overview Goals: Solution : Training strategies: Data collection strategy: • Extending the current capabilities of Almond to other • Joint and sequential training • Using neural machine languages in a cost and time translation models to produce efficient manner translated sentences • Enforcing low variance on encoded outputs on same • Avoiding template development sentences from different • Improving translation quality for each new language languages using domain-dependent rules

Data Collection method

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-Processing

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-Processing Neural Machine Translation Model (e.g. Google Translate)

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-Processing Neural Machine Translation Model (e.g. Google Translate) muestra todas las descripciones de las reseñas creadas por " Jennifer ".

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-Processing Neural Machine Translation Model (e.g. Google Translate) Feedback Collection & Rule Generation muestra todas las descripciones de las reseñas creadas por " Jennifer ". Post-Processing

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-processing rules Pre-Processing - Detokenize punctuation - Replace NUMBER with actual values - Lower case all parameter values Neural Machine … Translation Model (e.g. Google Translate) Feedback Collection & Rule Generation muestra todas las descripciones de las reseñas creadas por " Jennifer ". - Replace verbs with their imperative form - Insert missing prepositions Post-Processing - Replace translated parameter values with real values from target language … Post-processing rules

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-processing rules Pre-Processing - Detokenize punctuation - Replace NUMBER with actual values - Lower case all parameter values Neural Machine … Translation Model (e.g. Google Translate) Feedback Collection & Rule Generation muestra todas las descripciones de las reseñas creadas por " Jennifer ". - Replace verbs with their imperative form - Insert missing prepositions Post-Processing - Replace translated parameter values with real values from target language … Post-processing rules

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-processing rules Pre-Processing - Detokenize punctuation - Replace NUMBER with actual values - Lower case all parameter values Neural Machine … Translation Model (e.g. Google Translate) Feedback Collection & Rule Generation muestra todas las descripciones de las reseñas creadas por " Jennifer ". - Replace verbs with their imperative form - Insert missing prepositions Post-Processing - Replace translated parameter values with real values from target language … Parameter Matching Post-processing rules

Data Collection method Sentence Program display all review now => [description] of English Dataset descriptions authored by @restaurant.review, author Jennifer . == " Jennifer ") => notify Pre-processing rules Pre-Processing - Detokenize punctuation - Replace NUMBER with actual values - Lower case all parameter values Neural Machine … Translation Model (e.g. Google Translate) Feedback Collection & Rule Generation muestra todas las descripciones de las reseñas creadas por " Jennifer ". - Replace verbs with their imperative form - Insert missing prepositions Post-Processing - Replace translated parameter values with real values from target language … Parameter Matching Post-processing rules muestra todas las descripciones de las reseñas escritas por juan . Dataset in target language now => [description] of @restaurant.review, author == " juan ") => notify

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder now => [description] of @restaurant.review, author == " Jennifer ") => notify

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder Decoder Loss now => [description] of @restaurant.review, author == " Jennifer ") => notify

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder Decoder Loss now => [description] of @restaurant.review, author == " Jennifer ") => notify

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder Decoder Loss now => [description] of @restaurant.review, author == " Jennifer ") => notify

Naive Training display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。 Encoder We are not using the “ knowledge ” that these sentences are semantically equivalent Decoder Decoder Loss now => [description] of @restaurant.review, author == " Jennifer ") => notify

Training with sentence batching display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . 显 示 Jennifer 撰写的所有 评论 描述。

Training with sentence batching display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . Batching 显 示 Jennifer 撰写的所有 评论 描述。

Training with sentence batching display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . Batching 显 示 Jennifer 撰写的所有 评论 描述。 Encoder

Training with sentence batching display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . Batching 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Decoder

Training with sentence batching display all review descriptions authored by Jennifer . muestra todas las descripciones de las reseñas creadas por Jennifer . Batching 显 示 Jennifer 撰写的所有 评论 描述。 Encoder Encoder Loss Decoder