IBM-Backed llm-d 1.0 Adds Controls for AI Inference Workloads

Your call?🐂 Bullish🐻 Bearish

6.60M

output tokens/minute

The release also supports coordinated upgrades and context-aware routing. A pre-release benchmark reached 6.60 million output tokens per minute with 3,000 coding agents.