In this post, we’re going to discuss the following core topics:
1. Attention Mechanism
2. Transformer Architecture
3. Vision Transformer (ViT)
4. Detection Transformer (DETR)
5. Deformable Attention & Deformable DETR
6. Bi-directional Cross Attention & RT-DETR (Real-Time DETR)