Definition

AI hardware refers to specialized processors and accelerators designed for artificial intelligence workloads, including training and inference operations for machine learning models.

Recent Developments

Key Categories

  • Training Chips: GPUs and custom ASICs optimized for model training (e.g., NVIDIA H100, H200)
  • Inference Chips: Specialized processors for deploying trained models (e.g., jalapeno-chip, NVIDIA Blackwell, cerebras, etched)
  • Edge AI Hardware: Low-power processors for on-device inference
  • Neural Processing Units (NPUs): Specialized AI accelerators in consumer devices

Sources