Skip to content

SJ The Scaling Journey

GitHub LinkedIn Substack

Select theme

Writing
- Overview
- Essays
  - Getting Started with The Scaling Journey
- Notes
  - Notes
LLMs
- Overview
- Troiani
- Architecture
  - Architecture Variants
  - Attention Mechanisms
- Scaling
  - Compute Efficiency
  - Power Laws in LLMs
- Pre-training
- Mid-training
- Compression
- Retrieval & RAG
  - Embeddings & Indexing
  - RAG Systems
World Models
- Overview
- Foundations
- Prediction
  - Dynamics Models
  - Visual Prediction
- Workloads
- Evaluation
- Research notes
AI Infra
Me

GitHub LinkedIn Substack

Select theme

On this page

Overview
Inference

On this page

Overview
Inference

Inference systems

Inference

Section titled “Inference”

Placeholder for inference content.

Previous
Training systems Next
Cluster & platform