Validation Set

Domain: Data & Datasets

🎯 Motivation

A third data split used during training to tune hyperparameters. Separate from both training and test sets.

📋 Concrete Example

Split: 70% train, 15% validation, 15% test. Validation set is used to tune learning rate, model size, etc. Test set is used only for final evaluation.

🔗 Analogy

A dress rehearsal before opening night - rehearsal (train), dress rehearsal (validation, tune things), opening night (test, final evaluation).