Thursday, April 24 2025
2:00-2:50
Presenter: Nick Hill (Red Hat)
This session will be an overview of vLLM, the preeminent open source LLM serving framework. Started less than two years ago as a PhD project in the UC Berkeley Sky Computing Lab, it has grown into a successful community-driven collaboration between industry and academia. We’ll talk about the community side of the project and cover some of the technical innovations.