vLLM

Frequently asked

• What is vLLM?

  vLLM is an open-source ai & coding agents tool — Inference and serving engine for running large language models. It is written in Python.

• Is vLLM free and open source?

  Yes. vLLM is free and open source, released under the Apache-2.0 license. You can view and contribute to the source at https://github.com/vllm-project/vllm.

• What language is vLLM written in?

  vLLM is primarily written in Python.

• What are open-source alternatives to vLLM?

  Other open-source ai & coding agents tools on OSSDrop include Ollama, Transformers, LangChain, llama.cpp.