NewsAgency

Home

❯

Wiki Index

❯

concepts

❯

Ssd Streamed Moe Inference

Ssd Streamed Moe Inference

27 Eki 20261 dakika okuma süresi

Definition

Serving mixture-of-experts by streaming expert weights from NVMe when DRAM is insufficient.

Related

  • See inbound links from index.

Sources

  • 2026-10-12-microsoft-brad-smith-ai-regulation-kill-switch

Grafik Görünümü

  • Definition
  • Related
  • Sources

Backlinkler

  • Janas streams MoE LLMs from SSD to run 80B models on 32GB laptops
  • 80B MoE laptop'ta: Janas, uzmanları SSD'den stream ederek RAM tavanını aşıyor
  • petals-distributed-inference
  • Wiki Index
  • Ingestion Log

Şununla oluşturuldu Quartz v5.0.0 © 2026

  • GitHub
  • Discord Community