Skip to content
Numerous wires and cables mounted into server patch panel in modern data center

Omnissiah Systems

Field notes on operating the machine.

Recent Writing

autoscalinginference infrastructurecapacity planning

Autoscaler Lag: Why Your GPU Fleet Always Reacts Too Late

A close look at why GPU autoscalers consistently scale too slowly for inference traffic, and how to budget for the lag instead of fighting it.

· 4 min read

Dead Replica Detection: How Inference Fleets Carry Broken Workers Longer Than You Think

Sampling Parameter Drift: How Temperature and Top-P Shift Output Quality at Scale

Rank Assignment Under Fire: How Tensor Parallel Groups Break When Nodes Fail Mid-Run

Optimizer State Explosion: Why Your Training Memory Budget Collapses at Scale

Token Budget Exhaustion: What Happens When Your Context Window Fills Mid-Request
All posts →

About

Omnissiah Systems explores AI systems, MLOps, and distributed inference infrastructure, written as the disciplined study of large models as living machinery. New writing published regularly.