CUDA
Domain: Computer Systems
🎯 Motivation
NVIDIA’s platform for running code on GPUs. Lets you write programs that execute on GPU cores.
📋 Concrete Example
CUDA: write C++ code that runs on the GPU. ‘Run this matrix multiplication on 10,000 GPU cores.’ 100x faster than CPU for large matrices. Essential for deep learning.
🔗 Analogy
CUDA is like giving instructions to 10,000 factory workers - you write one set of instructions (CUDA code), and all 10,000 workers (GPU cores) execute it simultaneously on different data.