Google Translate
Algorithm
Class : 154008- Technical Writing And Presentation- IT2023
Student : Nguyễn Quốc Khánh- 20235118
Phạm Anh Khôi- 20230043
Teacher : Dương Thị Thùy Mai
How does it
actually
work?
Language Translation
How to translate English to French?
Word by word translation
Comment vieux sont
How old are you?
vous
I Commen
English- a tvieux
French Word Get pair ma sont
Translation
student vous
Language Translation
Tokens
Two components of Language
[Link]: Smallest units of language It is a beautiful day
[Link]: Defines ordering off tokens
#1: Adjectives follow
Adverbs Problem in word by word
#2: Nouns follow adjectives
#3: Conjunction can link 2
translation :
ideas ADV ADJ NOUN
….
1. Syntax: “very big cloud”
2. Semantic: “break the ice”
Language Translation
What is exactly
Millions example
English input about the neural French output
network?
It’s a very beautiful Neural C’est une très belle
day today journée aujourd’hui
network
Training Training
Sample input Sample
output
Language Translation
Vector
English sentence French sentence
Recurren
It’s a very beautiful Neural
t neural C’est une très belle
journée aujourd’hui
day today
network
network
Language Translation
Vector
French sentence
Recurrent
Neural C’est une très belle
neural
network
network
journée aujourd’hui
Language Translation
Encoder-decoder Architecture
Recurrent Recurrent
English Vector French
neural neural
input output
network network
Sequence-to- Vector-to-
vector sequence
Long short-term memory – Recurrent neural network
(LSTM-RNN)
Language Translation
Encoder-decoder Architecture
Higher BLEU Work
scoreBetter well at
Translation medium
sentenc
es
(15-20
words)
Language Translation
Encoder-Decoder
Architecture
LSTM-RNN
EncDec
Compare this
Language Translation
Encoder-Decoder
Architecture
LSTM-RNN
EncDec
Compare this
word n Components of Language
1. Tokens (words)
2. Grammar (context)
Also depends
on
Consider 1st
n words only
Components of Language
1. Tokens (words)
2. Grammar (context)
Translator
One word
at a time
Which word(s)?
English
Input
i n put
Align tput!
nd o u
a
French
Translation
Translator
One word
at a time
Which word(s)?
with Attention
(New way)
Large Improvement
for longer
sentences (50
Attention words)
Encoder Decoder
Mechanism
without Attention
(Old way)
Google Translate’s Architecture
Vous êtes un crétin
[ ][ ][ ][ ]
𝟎 . 𝟐𝟐 𝟎 . 𝟎𝟖 𝟎 . 𝟑𝟑 𝟎 .𝟏𝟖
𝟎 . 𝟏𝟓 𝟎 . 𝟑𝟐 𝟎 . 𝟎𝟓 𝟎 . 𝟏𝟑
𝟎 . 𝟎𝟗 𝟎 . 𝟏𝟔 𝟎 . 𝟐𝟔 𝟎 . 𝟑𝟐
𝟎 .𝟑 𝟎 . 𝟏𝟖 𝟎 . 𝟐𝟔 𝟎 . 𝟐𝟐
𝟎 .𝟐𝟒 𝟎 . 𝟐𝟔 𝟎 .𝟏 𝟎 . 𝟏𝟓
You are a moro
REFERENCE SOURCE
1. Neuron Machine Translation by jointly learning to align & translate (Bahdanau et al.,
2016)
2. How Google Translate Works - The Machine Learning Algorithm Explained! By CS
Dojo Community
3. Natural Language Processing In 10 Minutes by Simplilearn
4. What is NLP (Natural Language Processing)? by IBM Technology
5. What is NLP & How Does It Work? Neuro Linguistic Programming Basics by Bay Area
NLP And Hypnosis
Questions And Answers
Google Translate
Algorithm
THANK YOU FOR LISTENING