https://tonylee.bio/https://tonylee.bio/blog/https://tonylee.bio/blog/attention-from-first-principles/https://tonylee.bio/blog/attention-how-to-shrink-it/https://tonylee.bio/blog/distributed-inference-the-fleet/https://tonylee.bio/blog/moe-routing/https://tonylee.bio/blog/scheduling-continuous-batching-paged-attention/https://tonylee.bio/blog/tags/https://tonylee.bio/blog/tags/activation-functions/https://tonylee.bio/blog/tags/attention/https://tonylee.bio/blog/tags/continuous-batching/https://tonylee.bio/blog/tags/distributed-inference/https://tonylee.bio/blog/tags/ffn/https://tonylee.bio/blog/tags/flash-attention/https://tonylee.bio/blog/tags/gqa/https://tonylee.bio/blog/tags/kv-cache/https://tonylee.bio/blog/tags/mla/https://tonylee.bio/blog/tags/mlp/https://tonylee.bio/blog/tags/moe/https://tonylee.bio/blog/tags/paged-attention/https://tonylee.bio/blog/tags/prefill-decode/https://tonylee.bio/blog/tags/routing/https://tonylee.bio/blog/tags/scheduling/https://tonylee.bio/blog/tags/self-attention/https://tonylee.bio/blog/tags/serving/https://tonylee.bio/blog/tags/swiglu/https://tonylee.bio/blog/tags/transformer/https://tonylee.bio/blog/transformer-inference-prefill-and-decode/https://tonylee.bio/blog/why-transformers-need-the-mlp/https://tonylee.bio/experiments/autoscaling/https://tonylee.bio/experiments/batching/https://tonylee.bio/experiments/cost/https://tonylee.bio/experiments/fp4/https://tonylee.bio/experiments/kernel-decode-step-graph-replay/https://tonylee.bio/experiments/kernel-h200-matmul-autotune/https://tonylee.bio/experiments/kernel-matmul-tiling/https://tonylee.bio/experiments/kernel-memory-primitives/https://tonylee.bio/experiments/kernel-normalization-fusion/https://tonylee.bio/experiments/kernel-profiler-validation/https://tonylee.bio/experiments/kernel-reduction-strategy/https://tonylee.bio/experiments/kernel-softmax-fusion/https://tonylee.bio/experiments/kernel-swiglu-fusion/https://tonylee.bio/experiments/kv-cache/https://tonylee.bio/experiments/prefill-decode/https://tonylee.bio/experiments/request-patterns/https://tonylee.bio/resume/https://tonylee.bio/work/https://tonylee.bio/work/cuda-kernel-lab/https://tonylee.bio/work/gpu-inference-lab/