notbugAs an Amazon Associate I earn from qualifying purchases.
Want a good read? Try FreeBSD Mastery: Jails (IT Mastery Book 15)
Want a good monitor light? See my photos
All times are UTC
Ukraine
Port details
py-vllm High-throughput and memory-efficient LLM inference engine
0.19.0 miscnew! on this many watch lists=0 search for ports that depend on this port Find issues related to this port Report an issue related to this port View this port on Repology. pkg-fallout Package not present on quarterly.This port was created during this quarter. It will be in the next quarterly branch but not the current one.
Maintainer: yuri@FreeBSD.org search for ports maintained by this maintainer
Port Added: 2026-04-07 19:21:24
Last Update: 2026-04-07 19:19:14
Commit Hash: 919c360
Also Listed In: python
License: APACHE20
WWW:
https://vllm.ai/
https://github.com/vllm-project/vllm
Description:
vLLM is a fast and easy-to-use library for LLM inference and serving. It provides high-throughput and memory-efficient inference for large language models (LLMs) using state-of-the-art serving technologies including: - PagedAttention for efficient KV cache memory management - Continuous batching of incoming requests - Optimized CUDA kernels (on supported platforms) - Hugging Face model compatibility - Various decoding algorithms including parallel sampling and beam search - OpenAI-compatible API server On FreeBSD, vLLM runs in CPU/empty device mode (VLLM_TARGET_DEVICE=empty), providing pure Python inference without GPU acceleration.
HomepageHomepage    cgit ¦ Codeberg ¦ GitHub ¦ GitLab ¦ SVNWeb - no subversion history for this port

Manual pages:
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist
There is no configure plist information for this port.
USE_RC_SUBR (Service Scripts)
  • no SUBR information found for this port
Dependency lines:
  • ${PYTHON_PKGNAMEPREFIX}vllm>0:misc/py-vllm@${PY_FLAVOR}
To install the port:
cd /usr/ports/misc/py-vllm/ && make install clean
To add the package, run one of these commands:
  • pkg install misc/py-vllm
  • pkg install py311-vllm
NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above.
NOTE: This is a Python port. Instead of py311-vllm listed in the above command, you can pick from the names under the Packages section.
PKGNAME: py311-vllm
Package flavors (<flavor>: <package>)
  • py311: py311-vllm
distinfo:
TIMESTAMP = 1775582925 SHA256 (vllm-0.19.0.tar.gz) = 81e59cf87175e7a62eb8d9acf5989484bbd17089d5eface353f89067bda282d9 SIZE (vllm-0.19.0.tar.gz) = 31071745

Expand this list (2 items)

Collapse this list.

SHA256 (v3.10.tar.gz) = ba5834a1fdbb6d1c1b1c065dfd789438e7aa42c03fc52d92c02af85d78d1c75c SIZE (v3.10.tar.gz) = 13507701

Collapse this list.


No package information for this port in our database
Sometimes this happens. Not all ports have packages. This is doubly so for new ports, like this one.
Dependencies
NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered.
Build dependencies:
  1. clang : devel/llvm19
  2. py311-Jinja2>=3.0 : devel/py-Jinja2@py311
  3. py311-ninja>=1.13 : devel/py-ninja@py311
  4. py311-packaging>=24.2 : devel/py-packaging@py311
  5. py311-pytorch>=2.10.0 : misc/py-pytorch@py311
  6. py311-setuptools>=63.0 : devel/py-setuptools@py311
  7. py311-setuptools-scm>=8.0 : devel/py-setuptools-scm@py311
  8. py311-wheel>0 : devel/py-wheel@py311
  9. cmake : devel/cmake-core
  10. python3.11 : lang/python311
  11. py311-build>=0 : devel/py-build@py311
  12. py311-installer>=0 : devel/py-installer@py311
Test dependencies:
  1. py311-datasets>=4.8.2 : misc/py-datasets@py311
  2. py311-evaluate>=0.4.6 : misc/py-evaluate@py311
  3. py311-multiprocess>=0.70.19 : devel/py-multiprocess@py311
  4. py311-pytest-asyncio>=1.3.0 : devel/py-pytest-asyncio@py311
  5. py311-tblib>=3.2.2 : devel/py-tblib@py311
  6. py311-pytest>=7,1 : devel/py-pytest@py311
  7. python3.11 : lang/python311
Runtime dependencies:
  1. py311-aiohttp>=3.13.3 : www/py-aiohttp@py311
  2. py311-anthropic>0 : misc/py-anthropic@py311
  3. py311-blake3>0 : security/py-blake3@py311
  4. py311-cachetools>0 : devel/py-cachetools@py311
  5. py311-cbor2>0 : devel/py-cbor2@py311
  6. py311-cloudpickle>0 : devel/py-cloudpickle@py311
  7. py311-compressed-tensors>=0.14.0.1 : misc/py-compressed-tensors@py311
  8. py311-depyf>=0.20.0 : devel/py-depyf@py311
  9. py311-diskcache>=5.6.3 : devel/py-diskcache@py311
  10. py311-einops>0 : misc/py-einops@py311
  11. py311-fastapi>0 : www/py-fastapi@py311
  12. py311-filelock>=3.16.1 : sysutils/py-filelock@py311
  13. py311-gguf>=0.17.0 : misc/py-gguf@py311
  14. py311-ijson>0 : devel/py-ijson@py311
  15. py311-Jinja2>=3.0 : devel/py-Jinja2@py311
  16. py311-lark>=1.2.2 : devel/py-lark@py311
  17. py311-llguidance>=1.3.0 : textproc/py-llguidance@py311
  18. py311-lm-format-enforcer>=0.11.3 : misc/py-lm-format-enforcer@py311
  19. py311-mcp>0 : misc/py-mcp@py311
  20. py311-mistral-common>=1.10.0 : misc/py-mistral-common@py311
  21. py311-model-hosting-container-standards>=0.1.13 : misc/py-model-hosting-container-standards@py311
  22. py311-msgspec>0 : devel/py-msgspec@py311
  23. py311-ninja>=1.13 : devel/py-ninja@py311
  24. py311-numpy1>=1.25 : math/py-numpy1@py311
  25. py311-openai>=2.0.0 : misc/py-openai@py311
  26. py311-openai-harmony>=0.0.3 : misc/py-openai-harmony@py311
  27. py311-opentelemetry-api>=1.27.0 : devel/py-opentelemetry-api@py311
  28. py311-opentelemetry-exporter-otlp>=1.27.0 : devel/py-opentelemetry-exporter-otlp@py311
  29. py311-opentelemetry-sdk>=1.27.0 : devel/py-opentelemetry-sdk@py311
  30. py311-opentelemetry-semantic-conventions-ai>=0.4.1 : devel/py-opentelemetry-semantic-conventions-ai@py311
  31. py311-opencv-python-headless>=4.11.0 : graphics/py-opencv-python-headless@py311
  32. py311-outlines-core>=0.2.11 : textproc/py-outlines-core@py311
  33. py311-partial-json-parser>0 : textproc/py-partial-json-parser@py311
  34. py311-pillow>=10.0.0 : graphics/py-pillow@py311
  35. py311-prometheus-client>=0.18.0 : net-mgmt/py-prometheus-client@py311
  36. py311-prometheus-fastapi-instrumentator>=7.0.0 : www/py-prometheus-fastapi-instrumentator@py311
  37. py311-protobuf>=5.29.6 : devel/py-protobuf@py311
  38. py311-psutil>=5.9.0 : sysutils/py-psutil@py311
  39. py311-py-cpuinfo>0 : sysutils/py-py-cpuinfo@py311
  40. py311-pybase64>0 : devel/py-pybase64@py311
  41. py311-pydantic2>=2.12.0 : devel/py-pydantic2@py311
  42. py311-python-json-logger>0 : devel/py-python-json-logger@py311
  43. py311-pyyaml>0 : devel/py-pyyaml@py311
  44. py311-pyzmq>=25.0.0 : net/py-pyzmq@py311
  45. py311-regex>0 : textproc/py-regex@py311
  46. py311-requests>=2.26.0 : www/py-requests@py311
  47. py311-sentencepiece>0 : textproc/py-sentencepiece@py311
  48. py311-setproctitle>0 : devel/py-setproctitle@py311
  49. py311-setuptools>=63.0 : devel/py-setuptools@py311
  50. py311-tiktoken>=0.6.0 : textproc/py-tiktoken@py311
  51. py311-tokenizers>=0.21.1 : textproc/py-tokenizers@py311
  52. py311-tqdm>=4.0 : misc/py-tqdm@py311
  53. py311-uvloop>=0.20.0 : devel/py-uvloop@py311
  54. py311-transformers>=4.56.0 : misc/py-transformers@py311
  55. py311-pytorch>=2.10.0 : misc/py-pytorch@py311
  56. py311-typing-extensions>=4.10 : devel/py-typing-extensions@py311
  57. py311-watchfiles>0 : devel/py-watchfiles@py311
  58. py311-xgrammar>=0.1.32 : misc/py-xgrammar@py311
  59. python3.11 : lang/python311
Library dependencies:
  1. libabsl_status.so : devel/abseil
  2. libprotobuf.so : devel/protobuf
This port is required by:
for Run
  1. graphics/py-olmocr

Configuration Options:
No options to configure
Options name:
misc_py-vllm
USES:
cmake:indirect python
FreshPorts was unable to extract/find any pkg message
Master Sites:
Expand this list (2 items)
Collapse this list.
  1. https://files.pythonhosted.org/packages/source/v/vllm/
  2. https://pypi.org/packages/source/v/vllm/
Collapse this list.

Number of commits found: 1

Commit History - (may be incomplete: for full details, see links to repositories near top of page)
CommitCreditsLog message
0.19.0
07 Apr 2026 19:19:14
commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904commit hash: 919c3600edaed3248916e0b75d4249fa9903b904 files touched by this commit
Yuri Victorovich (yuri) search for other commits by this committer
misc/py-vllm: New port: High-throughput and memory-efficient LLM inference
engine

Number of commits found: 1