NVIDIA GPUs for AI

📌 Table of Contents

  1. Overview
  2. GPU Fundamentals
  3. GPU Architecture
  4. CUDA Programming Model
  5. Tensor Cores
  6. Memory Hierarchy
  7. GPU Interconnects (PCIe & NVLink)
  8. Distributed Training
  9. CUDA Ecosystem
  10. Performance Bottlenecks
  11. Key Terminology
  12. Mental Models
  13. References

1. Overview

Image

Image