Reading

• Build a Large Language Model (from Scratch)

  Sebastian Raschka

  in progress
  80%

• AI Engineering

  Chip Huyen

  todo

• Designing Machine Learning Systems

  Chip Huyen

  completed

• Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow

  Aurelien Geron

  completed

• Role of Bias Terms in Dot-Product Attention

  Mahdi Namazifar, Devamanyu Hazarika, Dilek Hakkani-Tur

  completed

• Attention Is All You Need

  Ashish Vaswani et al.

  completed

• An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale

  Alexey Dosovitskiy et al.

  completed

• GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

  Joshua Ainslie et al.

  completed

Papers, articles, and references bookmarked outside the core reading log.

• YouTube Music

  Unknown author

  webpage

• Cosine Similarity

  Antonio Lupetti

  blogPost2024

• Post-training 101 | Tokens for Thoughts

  Han Fang

  webpage

• Understanding the 4 Main Approaches to LLM Evaluation (From Scratch)

  Sebastian Raschka PhD

  webpage2025

• A Gentle Introduction to Graph Neural Networks

  Benjamin Sanchez-Lengeling, Emily Reif, Adam Pearce +1 more

  journalArticle2021

• A Visual Guide to Gemma 4

  Maarten Grootendorst

  webpage2024

• A Visual Guide to Gemma 4

  Maarten Grootendorst

  webpage2024

• Triton: an intermediate language and compiler for tiled neural network computations

  Philippe Tillet, H. T. Kung, David Cox

  conferencePaper2019

• Why do CPUs have multiple cache levels?

  Unknown author

  blogPost2016

• Quantization from the ground up

  Sam Rose

  webpage2026

• Tim Rocktäschel

  Tim Rocktaschel

  webpage

• Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordić

  Aleksa Gordic

  webpage

• Heterogeneous Graph Transformer

  Ziniu Hu, Yuxiao Dong, Kuansan Wang +1 more

  preprint2020

• Robust LLM Training Infrastructure at ByteDance

  Borui Wan, Gaohong Liu, Zuquan Song +32 more

  preprint2025

• DeepSeek's open-source week and why it's a big deal

  PySpur-AI Agent Builder

  webpage2025

• Reducing Activation Recomputation in Large Transformer Models

  Vijay Korthikanti, Jared Casper, Sangkug Lym +4 more

  preprint2022

• The Ultra-Scale Playbook - a Hugging Face Space by nanotron

  Unknown author

  webpage

• Role of Bias Terms in Dot-Product Attention

  Mahdi Namazifar, Devamanyu Hazarika, Dilek Hakkani-Tur

  preprint2023

• GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

  Joshua Ainslie, James Lee-Thorp, Michiel de Jong +3 more

  preprint2023

• Gemma 3 Technical Report

  Gemma Team, Aishwarya Kamath, Johan Ferret +213 more

  preprint2025

• Scaling Rectified Flow Transformers for High-Resolution Image Synthesis

  Patrick Esser, Sumith Kulal, Andreas Blattmann +14 more

  preprint2024

• Denoising Diffusion Probabilistic Models

  Jonathan Ho, Ajay Jain, Pieter Abbeel

  preprint2020

• V-VAE: A Variational Auto Encoding Framework Towards Fine-Grained Control over Human-Like Chat

  Qi Lin, Weikai Xu, Lisi Chen +1 more

  preprint2025

• Generative Adversarial Networks

  Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza +5 more

  preprint2014

• Auto-Encoding Variational Bayes

  Diederik P. Kingma, Max Welling

  preprint2022

• LoRA: Low-Rank Adaptation of Large Language Models

  Edward J. Hu, Yelong Shen, Phillip Wallis +5 more

  preprint2021

• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

  Patrick Lewis, Ethan Perez, Aleksandra Piktus +9 more

  preprint2021

• forejune.co/cuda/

  Unknown author

  webpage

• Understanding Positional Encoding in Transformers - Blog by Kemal Erdem

  Unknown author

  webpage

• Model Evaluation, Model Selection, and Algorithm Selection in Machine Learning

  Sebastian Raschka

  preprint2020

• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

  Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov +9 more

  preprint2021

• Papers with Code - Vision Transformer Explained

  Unknown author

  webpage

• The State of LLM Reasoning Models

  Sebastian Raschka PhD

  webpage2025

• In Search of an Understandable Consensus Algorithm

  Diego Ongaro, John Ousterhout

  journalArticle

• Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphs

  Yu A. Malkov, D. A. Yashunin

  preprint2018