Learning to Route LLMs from Implicit Cost-Performance Preferences via Meta-Learning

arXiv:2606.06178v1 Announce Type: cross Abstract: Large language models (LLMs) present a trade-off between performance and cost, where more powerful models incur greater expense. LLM routing aims to mitigate expenses while maintaining performance by sending queries to the most suitable model. However, existing methods cannot perform well for...

Læs hele artiklen hos kilden.