Summer Training
&
Jobs
تدريب صيفي - وظائف
انشاء حساب / دخول
المدونة
الدورات
إسلاميات
وظائف
تدريب صيفي
منح
بودكاست
الرئيسية
دورات تدريبية
Learn AI
Build a Large Language Model (From Scratch) – Live Coding with Sebastian Raschka
محتوى الدورة
⚙️ Initializing a Model with Pretrained Weights – Live Coding with Sebastian Raschka (Chapter 6.4)
🤖 Using GPT to Generate Text – Live Coding with Sebastian Raschka (Chapter 5.1.1)
📉 Calculating Text Generation Loss – Live Coding with Sebastian Raschka (Chapter 5.1.2)
📊 Training & Validation Loss – Live Coding with Sebastian Raschka (Chapter 5.1.3)
🚀 Training a Large Language Model – Live Coding with Sebastian Raschka (Chapter 5.2)
🌡️ Temperature Scaling in Text Generation – Live Coding with Sebastian Raschka (Chapter 5.3.1)
🔝 Top-k Sampling for Text Generation – Live Coding with Sebastian Raschka (Chapter 5.3.2)
🛠️ Modifying the Text Generation Function – Live Coding with Sebastian Raschka (Chapter 5.3.3)
💾 Loading and Saving Model Weights in PyTorch – Live Coding with Sebastian Raschka (Chapter 5.4)
🧠 Loading Pretrained Weights from OpenAI – Live Coding with Sebastian Raschka (Chapter 5.5)
📂 Preparing the Dataset – Live Coding with Sebastian Raschka (Chapter 6.2)
📦 Creating Data Loaders – Live Coding with Sebastian Raschka (Chapter 6.3)
✍️ Generating Text with a GPT Model – Live Coding with Sebastian Raschka (Chapter 4.7)
🏷️ Adding a Classification Head – Live Coding with Sebastian Raschka (Chapter 6.5)
📊 Calculating Classification Loss and Accuracy – Live Coding with Sebastian Raschka (Chapter 6.6)
🛠️ Fine-Tuning the Model on Supervised Data – Live Coding with Sebastian Raschka (Chapter 6.7)
📨 Using the LLM as a Spam Classifier – Live Coding with Sebastian Raschka (Chapter 6.8)
🧾 Preparing a Dataset for Instruction Fine-Tuning – Live Coding with Sebastian Raschka (Chapter 7.2)
📦 Organizing Data into Training Batches – Live Coding with Sebastian Raschka (Chapter 7.3)
🔄 Creating Data Loaders for an Instruction Dataset – Live Coding w/ Sebastian Raschka (Chapter 7.4)
📥 Loading a Pretrained LLM – Live Coding with Sebastian Raschka (Chapter 7.5)
🧠 Fine-Tuning the LLM on Instruction Data – Live Coding with Sebastian Raschka (Chapter 7.6)
💬 Extracting and Saving Responses – Live Coding with Sebastian Raschka (Chapter 7.7)
✅ Evaluating the Fine-Tuned LLM – Live Coding with Sebastian Raschka (Chapter 7.8)
🚫 Applying a Causal Attention Mask – Live Coding with Sebastian Raschka (Chapter 3.5.1)
🔤 Tokenizing Text - Live Coding with Sebastian Raschka (Chapter 2.2)
🔢 Convert Tokens into Token IDs - Live Coding with Sebastian Raschka (Chapter 2.3)
🔖 Adding Special Context Tokens - Live Coding with Sebastian Raschka (Chapter 2.4)
🔗 Byte Pair Encoding (BPE) – Live Coding with Sebastian Raschka (Chapter 2.5)
📚 Data Sampling with a Sliding Window – Live Coding with Sebastian Raschka (Chapter 2.6)
🧠 Creating Token Embeddings – Live Coding with Sebastian Raschka (Chapter 2.7)
📐 Encoding Word Positions – Live Coding with Sebastian Raschka (Chapter 2.8)
🧮 A Simple Self-Attention Mechanism – Live Coding w/ Sebastian Raschka (3.3.1.)
🎯 Computing Attention Weights – Live Coding with Sebastian Raschka (Transformer Mechanics Explained)
🧠 Step-by-Step Guide to Computing Attention Weights – Live Coding w/ Sebastian Raschka (Ch. 3.4.1)
🧱 Implementing a Compact Self-Attention Class – Live Coding with Sebastian Raschka (Chapter 3.4.2)
🔧 Live Coding with Sebastian Raschka: Python Environment Setup for Building LLMs
🛡️ Masking Additional Attention Weights with Dropout – Live Coding w/ Sebastian Raschka (Ch. 3.5.2)
🔒 Implementing a Compact Causal Self-Attention Class – Live Coding w/ Sebastian Raschka (Ch. 3.5.3)
🧱 Stacking Multiple Single-Head Attention Layers – Live Coding w Sebastian Raschka (Ch. 3.6.1)
🧠 Multi-Head Attention with Weight Splits – Live Coding with Sebastian Raschka (Chapter 3.6.2)
🏗️ Coding an LLM Architecture – Live Coding with Sebastian Raschka (Chapter 4.1)
🧮 Layer Normalization in Transformers – Live Coding with Sebastian Raschka (Chapter 4.2)
⚡ Implementing a feed forward network with GELU – Live Coding with Sebastian Raschka (Chapter 4.3)
🔁 Adding Shortcut Connections – Live Coding with Sebastian Raschka (Chapter 4.4)
🔗 Connecting Attention & Linear Layers – Live Coding w/ Sebastian Raschka (Chapter 4.5)
🧠 Coding the GPT Model – Live Coding with Sebastian Raschka (Chapter 4.6)
للحصول على شهادة
1-
التسجيل
2- مشاهدة الكورس كاملا
3- متابعة نسبة اكتمال الكورس تدريجيا
4- بعد الانتهاء تظهر الشهادة في الملف الشخصي الخاص بك
بحث
×