Papers
- Role of Bias Terms in Dot-Product Attention
- Attention Is All You Need
- An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale
- GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints
- Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs