Nov 3, 2026
CSS336 Lecture1&2
Based on the first two lectures of Stanford CS336, this note introduces the fundamentals of large language model training, including neural network training, tensor operations, floating-point precision, and computational cost estimation. It also covers memory optimization, GPU performance analysis, and the differences between dense and MoE models, providing a foundation for understanding and optimizing LLM training.
