model routing
sending each AI request to the model best suited to it
Model routing means placing a decision step in front of several AI models. For each request, it picks a model based on difficulty, cost, speed or past results. Easy work goes to a cheap model and hard work to a strong one. The aim is the same quality for less money.
Think of it as
A hospital triage nurse who sends minor cases to a nurse practitioner and serious ones to a consultant.
Ideas that use this term