sgl-project

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

Trusted Project Python
27.6k stars via trending-python
View on GitHub
← Back to Trending Repos