vllm-project

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge