Choose the fallback order
A virtual model in Tiller Router can point to several real models. Your application requests the same virtual model every time. Tiller tries the preferred provider first and can move to a backup when a supported error occurs.
For example, you might use a low-cost model normally, with a second provider available when it is rate-limited.
When a provider fails
Fallback occurs transparently to clients within Tiller Router. The replacement model handles the turn and the failed one is skipped for a definable cooldown period.
