49. Fine-Tuning

Pretraining teaches a model general language patterns.

Fine-tuning adapts the model to a specific task or dataset.

A common instruction-tuning flow is:

pretrained model
 ↓
instruction dataset
 ↓
supervised fine-tuning
 ↓
specialized model

The model's existing knowledge provides the starting point.