An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (2021)
Preview unavailable
You must log in or sign up to view this lesson.
Login
Sign up
SEGFORMERS Exploration
Buy now
Learn more
Enter Segformers
Attention & Transformers
Introduction to Segformers
What is Attention?
Recap: The Attention Timeline
Other Types of Attention
How to Visualize Attention Maps without Code
2
Transformers
Attention & Transformers Q&A
3
Segformer Networks
2
Mini-Workshop: Visually Understanding Query, Key, and Value
4
Vault: Research Paper Study 🔐
Attention is all you need (2017)
1
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (2021)
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers (2021)
Karpathy on Transformers
Segformers Workshop
The Segformers Starter Block Workshop
Block 1 — Overlap Patch Embeddings
Block 2 — Efficient Self-Attention
2
Block 3 — Mix FFNs
2
Assemble: The Transformer Block
2
Workshop SegFormer: Part 1
3
Workshop SegFormer: Encoder
Workshop SegFormer: Decoder
Workshop Segformer: Train & Run
10
Visualizing the Attention Maps
2
Bonus: Drivable Area Detection Notebook
Hourra!