Lesson 11 of 14 · Sequences and language
The transformer
Self-attention, multi-head attention, positional encoding and the transformer block, built in PyTorch, then BERT and GPT in context.
15 min read
Opening the lesson…
Lesson 11 of 14 · Sequences and language
Self-attention, multi-head attention, positional encoding and the transformer block, built in PyTorch, then BERT and GPT in context.
15 min read
Opening the lesson…