LLMs from Scratch – From Base Model to PPO & RLHF

عدد الدروس : 1 عدد ساعات الدورة : 06:06:21 شهادة معتمدة : نعم التسجيل في الدورة للحصول على شهادة

للحصول على شهادة

  • 1- التسجيل
  • 2- مشاهدة الكورس كاملا
  • 3- متابعة نسبة اكتمال الكورس تدريجيا
  • 4- بعد الانتهاء تظهر الشهادة في الملف الشخصي الخاص بك
A practical deep-dive course covering how to build language models from scratch, then align them using reinforcement learning from human feedback (RLHF) and PPO.
عن الدورة

This course “LLMs from Scratch – Practical Engineering from Base Model to PPO RLHF” is an advanced, hands-on learning path focused on building and aligning large language models from the ground up. It is designed for learners who want to understand not only how LLMs are built, but also how they are improved and aligned with human preferences.

The course begins with the fundamentals of constructing a base language model from scratch, including data preparation, tokenization, model architecture, and training workflows. Learners gain a clear understanding of how modern transformer-based models are built and optimized.

It then moves into model training strategies, explaining how large-scale models learn language patterns through pretraining on massive datasets.

A key focus of the course is reinforcement learning from human feedback (RLHF), which is used to align models with human intent and improve response quality. Learners explore how human preferences are incorporated into training pipelines.

The course also introduces PPO (Proximal Policy Optimization), a core algorithm used in RLHF to fine-tune language models safely and effectively.

In addition, learners study the full alignment pipeline, from base model creation to reward modeling and policy optimization.

By the end of this course, learners will understand both how LLMs are built from scratch and how they are aligned to behave more usefully and sa