AI Foundation - Domain 05
NLP & Large Language Models
From word embeddings to GPT-4 — tokenisation, pre-training, fine-tuning, prompting, RAG, and alignment.
Tier 3 - Advanced AI
Content Coming Soon
This domain is actively being written. All 8 chapters are planned and outlined. Check back soon, or explore Domain 01 and 02 which are fully available.
Planned Chapters
Ch 5.1
Word Embeddings
Coming Soon Ch 5.2
The Transformer Architecture
Coming Soon Ch 5.3
BERT & Encoder Models
Coming Soon Ch 5.4
GPT & Decoder Models
Coming Soon Ch 5.5
Pre-training & Scaling Laws
Coming Soon Ch 5.6
Fine-tuning & LoRA
Coming Soon Ch 5.7
Prompt Engineering
Coming Soon Ch 5.8
RAG & Grounding
Coming Soon