chalk.PricingSign in

Index

Library / AI / Serving LLMs

Routing and Cascades

Lab The cascade threshold

Paper Centaurs and Cyborgs on the Jagged Frontier

Included with a plan

This board is included with a plan. The first three lessons of every track are free, with their boards and videos. A plan unlocks every lesson, board, video, lab and paper for one price.

View plans →Already a member? Sign in

Lessons that use this board

Routing and Cascades. 06 · ROUTING & CASCADES — NOT EVERY REQUEST NEEDS THE BIG MODEL one queue, three kinds of question, three models that cost 75× apart. the serving layer's last lever is choosing WHI

Saved in this browser only.

← Constrained Decoding