Stanford CME295 – LLM Training (Autumn 2025 Lecture 4)

عدد الدروس : 1 عدد ساعات الدورة : شهادة معتمدة : نعم التسجيل في الدورة للحصول على شهادة

للحصول على شهادة

  • 1- التسجيل
  • 2- مشاهدة الكورس كاملا
  • 3- متابعة نسبة اكتمال الكورس تدريجيا
  • 4- بعد الانتهاء تظهر الشهادة في الملف الشخصي الخاص بك
An advanced lecture focused on Large Language Model (LLM) training strategies, scaling techniques, and optimization methods from Stanford CME295.
عن الدورة

This lecture from Stanford CME295: Transformers & Large Language Models (Autumn 2025) provides a deep technical exploration of how Large Language Models are trained at scale. It focuses on the full LLM training pipeline, from data preparation and tokenization to distributed optimization across large compute clusters.

The lecture explains autoregressive training objectives, next-token prediction, and large-scale dataset construction. You will learn how training stability is maintained using normalization strategies, learning rate scheduling, gradient clipping, and regularization techniques. The course also discusses scaling laws and how model performance improves with larger datasets and parameter sizes.

A key part of the lecture covers distributed training methods such as data parallelism, model parallelism, and pipeline parallelism, which are essential for training billion-parameter models efficiently. Hardware considerations, memory optimization, and cost-efficiency strategies