In development · Simulation only2026
The Orchestrator
A router that picks which LLM should handle each request, tested in simulation.
- TypeScript
The Orchestrator is a contextual bandit router for LLM calls, written in TypeScript. In simulation only, when gated, its regret was 22% lower than static rules.
What I measured
With the gate on, regret was 22% lower than static rules. With the gate off it did worse. 585 offline tests pass.
What it doesn't show
Everything here comes from simulation. I haven't run it against live traffic, so treat the 22% as a result about the simulator, not about production.
Last updated 12 Nov 2026