Port details
py-datasets HuggingFace community-driven open-source library of datasets
5.1.0 misc Σ 5.0.1Version of this port present on the latest quarterly branch. Maintainer: yuri@FreeBSD.org Port Added: 2024-08-06 09:48:10Last Update: 2026-10-15 23:42:25Commit Hash: 19f4c0f Also Listed In: python License: MITWWW: https://huggingface.co/docs/datasets/index https://github.com/huggingface/datasets Description: # Datasets is a library for easily accessing and sharing datasets for Audio,
Computer Vision, and Natural Language Processing (NLP) tasks.
Load a dataset in a single line of code, and use our powerful data processing
methods to quickly get your dataset ready for training in a deep learning model.
Backed by the Apache Arrow format, process large datasets with zero-copy reads
without any memory constraints for optimal speed and efficiency. We also feature
a deep integration with the Hugging Face Hub, allowing you to easily load and
share a dataset with the wider machine learning community. Manual pages: # FreshPorts has no man page information for this port.
pkg-plist: make generate-plist # There is no configure plist information for this port. USE_RC_SUBR (Service Scripts)
no SUBR information found for this port
Dependency lines :
${PYTHON_PKGNAMEPREFIX}datasets>0:misc/py-datasets@${PY_FLAVOR} To install the port : # cd /usr/ports/misc/py-datasets/ && make install clean To add the package , run one of these commands: pkg install misc/py-datasets pkg install py312-datasets py312-datasets listed in the above command, you can pick from the names under the Packages section.PKGNAME: py312-datasets Package flavors (<flavor>: <package> ) # distinfo: # TIMESTAMP = 1791788636
SHA256 (datasets-5.1.0.tar.gz) = 1561347daa8841b51351ef2ad1647b4ee4af406852c0f7bd1df587ac1ca7888e
SIZE (datasets-5.1.0.tar.gz) = 687306
Packages (timestamps in pop-ups are UTC): #
Dependencies # NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered. Build dependencies: #
py312-pyproject-hooks>0 : devel/py-pyproject-hooks@py312 py312-setuptools>0 : devel/py-setuptools@py312 py312-wheel>0 : devel/py-wheel@py312 python3.12 : lang/python312 py312-build>=0 : devel/py-build@py312 py312-installer>=0 : devel/py-installer@py312
Test dependencies: #
py312-absl-py>=0 : devel/py-absl-py@py312 py312-elasticsearch>0 : textproc/py-elasticsearch@py312 py312-faiss>=1.6.4 : math/py-faiss@py312 py312-jax>=0.3.14 : math/py-jax@py312 py312-jiwer>0 : misc/py-jiwer@py312 py312-joblib>=1.3.0 : devel/py-joblib@py312 py312-lz4>=0 : archivers/py-lz4@py312 py312-polars>=0.20.0 : misc/py-polars@py312 py312-protobuf>=4.0.0 : devel/py-protobuf@py312 py312-pytest-datadir>=0 : devel/py-pytest-datadir@py312 py312-pytest-xdist>=0 : devel/py-pytest-xdist@py312 py312-pytest>=0 : devel/py-pytest@py312 py312-pytorch>=2.0.0 : misc/py-pytorch@py312 py312-rarfile>=4.0 : archivers/py-rarfile@py312 py312-s3fs>=2021.11.1 : filesystems/py-s3fs@py312 py312-tiktoken>=0 : textproc/py-tiktoken@py312 py312-typing-extensions>=4.6.1 : devel/py-typing-extensions@py312 py312-zstandard>=0 : archivers/py-zstandard@py312 py312-pytest>=7,1 : devel/py-pytest@py312 python3.12 : lang/python312
Runtime dependencies: #
py312-aiohttp>0 : www/py-aiohttp@py312 py312-dill>0.3.0 : devel/py-dill@py312 py312-filelock>0 : sysutils/py-filelock@py312 py312-fsspec>=2023.1.0 : filesystems/py-fsspec@py312 py312-huggingface-hub>=1.31.0 : misc/py-huggingface-hub@py312 py312-multiprocess>0 : devel/py-multiprocess@py312 py312-numpy>=1.17 : math/py-numpy@py312 py312-packaging>0 : devel/py-packaging@py312 py312-pandas>0 : math/py-pandas@py312 py312-pyarrow>=24.0.0 : databases/py-pyarrow@py312 py312-pyyaml>=5.1 : devel/py-pyyaml@py312 py312-tqdm>=4.66.3 : misc/py-tqdm@py312 py312-xxhash>0 : devel/py-xxhash@py312 py312-torchcodec>=0.6.0 : multimedia/py-torchcodec@py312 py312-pytorch>=2.8.0 : misc/py-pytorch@py312 py312-pillow>=7.0.0 : graphics/py-pillow@py312 python3.12 : lang/python312
This port is required by: # for Run #
misc/colibri misc/py-evaluate textproc/py-docling-eval for Test #
misc/py-accelerate misc/py-peft misc/py-vllm textproc/py-tokenizers Configuration Options : # No options to configure Options name : # misc_py-datasets USES: # python
pkg-message: # FreshPorts was unable to extract/find any pkg message Master Sites: #
Commit History - (may be incomplete: for full details, see links to repositories near top of page) Commit Credits Log message 5.1.0 Yuri Victorovich (yuri) misc/py-datasets: update 5.0.1 → 5.1.0 5.0.1 Yuri Victorovich (yuri) misc/py-datasets: update 5.0.0 → 5.0.1 5.0.0 Yuri Victorovich (yuri) misc/py-datasets: update 4.8.5 → 5.0.0 4.8.5_1 Max Brazhnikov (makc) */*: bump PORTREVISION after switching to NumPy 2.x 4.8.5 Max Brazhnikov (makc) */*: Switch to NumPy 2.x
PR: 294328
Exp-run: antoine 4.8.5 Yuri Victorovich (yuri) misc/py-datasets: update 4.8.2 → 4.8.5 4.8.2_1 Charlie Li (vishwin) python.mk: retire ${PYNUMPY}
With both math/py-numpy (2) and math/py-numpy1, the variable stopped
making sense. Also remove the upper version bound. 4.8.2_1 Charlie Li (vishwin) math/py-numpy: switch all consumers to math/py-numpy1
...and bump PORTREVISIONs of consumers with hard RUN_DEPENDS
PR: 281470 4.8.2 Yuri Victorovich (yuri) misc/py-datasets: update 4.1.1 → 4.8.2 4.1.1_1 Vsevolod Stakhov (vsevolod) security/libsodium: Update to 1.0.21
The API remains compatible but bumping all dependent ports as SHLIB
has changed.
Changelog: https://github.com/jedisct1/libsodium/releases/tag/1.0.21-RELEASE
Security: https://00f.net/2025/12/30/libsodium-vulnerability/
PR: 279347 4.1.1 Yuri Victorovich (yuri) misc/py-datasets: update 3.5.0 → 4.1.1 3.5.0_1 Rene Ladan (rene) all: bump PORTREVISION after updating graphics/libyuv
Using the Tools/scripts/bump_revision.pl script 3.5.0 Yuri Victorovich (yuri) misc/py-datasets: update 3.3.0 → 3.5.0 3.3.0 Yuri Victorovich (yuri) misc/py-datasets: update 3.1.0 → 3.3.0
Reported by: portscout 3.1.0 Robert Clausecker (fuz) filesystems: add new category for file systems and related utilities
The filesystems category houses file systems and file system utilities.
It is added mainly to turn the sysutils/fusefs-* pseudo-category into
a proper one, but is also useful for the sundry of other file systems
related ports found in the tree.
Ports that seem like they belong there are moved to the new category.
Two ports, sysutils/fusefs-funionfs and sysutils/fusefs-fusepak are
not moved as they currently don't fetch and don't have TIMESTAMP set
in their distinfo, but that is required to be able to push a rename
of the port by the pre-receive hook.
Approved by: portmgr (rene)
Reviewed by: mat
Pull Request: https://github.com/freebsd/freebsd-ports/pull/302
PR: 281988 3.1.0 Yuri Victorovich (yuri) misc/py-datasets: update 2.21.0 → 3.1.0 2.21.0_1 Po-Chuan Hsieh (sunpoet) devel/py-pyproject-hooks: Move devel/py-pyproject_hooks to
devel/py-pyproject-hooks
- Bump PORTREVISION of dependent ports for dependency change 2.21.0 Yuri Victorovich (yuri) misc/py-datasets: Fix build by relaxing py-dill dependency
Reported by: fallout 2.21.0 Yuri Victorovich (yuri) misc/py-datasets: update 2.20.0 → 2.21.0
Reported by: portscout 2.20.0 Yuri Victorovich (yuri) misc/py-datasets: New port: HuggingFace community-driven open-source library of
datasets
