> blog --category
LLM Architectures
6 posts2025–2026
LLM Architectures
- Scaling Up RL: From Q-Tables to Deep Q-Networks (DQN) (opens on Medium)
Stop counting states and start approximating them. Here is how DQN scales Reinforcement Learning to the infinite.
- From Q-Learning to LLMs: Mastering the Bedrock of Post-Training (opens on Medium)
Master the basics of Value-Based Learning before diving into complex policy-based methods like PPO and GRPO.
- The Intuition Behind LoRA & QLoRA: Fine-Tuning LLMs Without Going Broke (opens on Medium)
Large Language Models (LLMs) have unlocked extraordinary capabilities, but all are trained on general-purpose data. You have to write long…
- The Secret to the First Word: How LLMs Build Context with Prefill (opens on Medium)
A technical-but-simple guide to how LLMs process your prompt, build the KV Cache, and why it impacts response speed (TTFT)
- How LLMs Understand Your Prompt: A Deep Dive into Prefill Attention (opens on Medium)
Go beyond Q, K, V. Learn how causal masks, parallel heads, and the KV cache work together to process your prompt instantly
- From Prompt to Response: Unpacking the Magic of LLM Inference (opens on Medium)
Learn how Large Language Models (LLMs) work. This guide breaks down LLM inference into two simple phases: the prefill and the decode.