Course 5الكورس 5 · DL Specialization

Sequence Models

Recurrent Neural Networks · Natural Language Processing & Word Embeddings · Sequence Models & Attention Mechanism · Transformer Network.

4 weeksأسابيع37 lecturesمحاضرة137 figures and slidesرسمة وسلايد4 slide decksعروض تقديمية

Course outlineمحتوى الكورس4

1
Week 1الأسبوع 1

Recurrent Neural Networks

Not startedلسه~57 min · 19 lessons19 درسPPTX · 2.1 MB
–
Open weekافتح الأسبوع
Slides of Recurrent Neural Networks
View the 12 lecturesشوف الـ 12 محاضرة
  1. Why Sequence Models? (title from the syllabus, not verified)
  2. Notation (title from the syllabus, not verified)
  3. Recurrent Neural Network Model (title from the syllabus, not verified)
  4. Backpropagation Through Time (title from the syllabus, not verified)
  5. Different Types of RNNs
  6. Language Model and Sequence Generation
  7. Sampling Novel Sequences
  8. Vanishing Gradients with RNNs
  9. Gated Recurrent Unit (GRU)
  10. Long Short Term Memory (LSTM)
  11. Bidirectional RNN
  12. Deep RNNs
2
Week 2الأسبوع 2

Natural Language Processing & Word Embeddings

Not startedلسه~44 min · 17 lessons17 درسPPTX · 1.3 MB
–
Open weekافتح الأسبوع
Slides of Natural Language Processing & Word Embeddings
View the 10 lecturesشوف الـ 10 محاضرة
  1. Word Representation (title from the syllabus, not verified)
  2. Using Word Embeddings (title from the syllabus, not verified)
  3. Properties of Word Embeddings
  4. Embedding Matrix
  5. Learning Word Embeddings
  6. Word2Vec
  7. Negative Sampling
  8. GloVe Word Vectors
  9. Sentiment Classification
  10. Debiasing Word Embeddings
3
Week 3الأسبوع 3

Sequence Models & Attention Mechanism

Not startedلسه~40 min · 17 lessons17 درسPPTX · 1.8 MB
–
Open weekافتح الأسبوع
Slides of Sequence Models & Attention Mechanism
View the 10 lecturesشوف الـ 10 محاضرة
  1. Basic Models
  2. Picking the Most Likely Sentence
  3. Beam Search
  4. Refinements to Beam Search
  5. Error Analysis in Beam Search
  6. Bleu Score (Optional)
  7. Attention Model Intuition
  8. Attention Model (title from the syllabus, not verified)
  9. Speech Recognition (title from the syllabus, not verified)
  10. Trigger Word Detection (title from the syllabus, not verified)
4
Week 4الأسبوع 4

Transformer Network

Not startedلسه~25 min · 12 lessons12 درسPPTX · 1.0 MB
–
Open weekافتح الأسبوع
Slides of Transformer Network
View the 5 lecturesشوف الـ 5 محاضرة
  1. Transformer Network Intuition (title from the syllabus, not verified)
  2. Self-Attention (title from the syllabus, not verified)
  3. Multi-Head Attention (title from the syllabus, not verified)
  4. Transformer Network (title from the syllabus, not verified)
  5. Conclusion and Thank You (title from the syllabus, not verified)