Port details
py-pytokens Fast, spec compliant Python 3.14+ tokenizer that runs on older Pythons
0.4.1 devel Σ =0 0.4.1Version of this port present on the latest quarterly branch. Maintainer: sunpoet@FreeBSD.org Port Added: 2025-11-30 07:21:05
Last Update: 2026-05-02 11:14:57
Commit Hash: 03c4b15
Also Listed In: python
License: MIT
WWW: https://github.com/tusharsadhwani/pytokens Description: # pytokens provides a fast, spec compliant Python 3.14+ tokenizer that runs on
older Pythons. ¦ ¦ ¦ ¦
Manual pages: #
FreshPorts has no man page information for this port.
pkg-plist: as obtained via: make generate-plist # There is no configure plist information for this port. USE_RC_SUBR (Service Scripts)
no SUBR information found for this port
Dependency lines :
${PYTHON_PKGNAMEPREFIX}pytokens>0:devel/py-pytokens@${PY_FLAVOR} To install the port : # cd /usr/ports/devel/py-pytokens/ && make install clean To add the package , run one of these commands: pkg install devel/py-pytokens pkg install py311-pytokens NOTE: If this package has multiple flavors (see below), then use one of them instead of the name specified above. NOTE: This is a Python port. Instead of py311-pytokens listed in the above command, you can pick from the names under the Packages section.PKGNAME: py311-pytokens Package flavors (<flavor>: <package> ) # distinfo: # TIMESTAMP = 1769874368
SHA256 (pytokens-0.4.1.tar.gz) = 292052fe80923aae2260c073f822ceba21f3872ced9a68bb7953b348e561179a
SIZE (pytokens-0.4.1.tar.gz) = 23015
Packages (timestamps in pop-ups are UTC): #
Dependencies # NOTE: FreshPorts displays only information on required and default dependencies. Optional dependencies are not covered. Build dependencies: #
py311-mypy>=0 : devel/py-mypy@py311 py311-setuptools>=61 : devel/py-setuptools@py311 py311-wheel>=0 : devel/py-wheel@py311 python3.11 : lang/python311 py311-build>=0 : devel/py-build@py311 py311-installer>=0 : devel/py-installer@py311
Test dependencies: #
python3.11 : lang/python311
Runtime dependencies: #
python3.11 : lang/python311
This port is required by: # for Run #
devel/py-black
Configuration Options : #
No options to configure Options name : #
devel_py-pytokens USES: #
python
FreshPorts was unable to extract/find any pkg message # Master Sites: #
Number of commits found: 4 #
Commit History - (may be incomplete: for full details, see links to repositories near top of page)
Commit Credits Log message
0.4.1 02 May 2026 11:14:57
Po-Chuan Hsieh (sunpoet)
devel/py-pytokens: Revert 6a05e8ff29faadf1b71602d22b8b4cb6db2f0997
The commit is incorrect.
PR: 294779
0.4.1 01 May 2026 02:03:42
Yuri Victorovich (yuri) Author: David Gilbert
devel/py-pytokens: Unbreak
PR: 294779
0.4.1 03 Feb 2026 05:09:45
Po-Chuan Hsieh (sunpoet)
devel/py-pytokens: Update to 0.4.1
Changes: https://github.com/tusharsadhwani/pytokens/commits/main
0.3.0 30 Nov 2025 07:16:57
Po-Chuan Hsieh (sunpoet)
devel/py-pytokens: Add py-pytokens 0.3.0
pytokens provides a fast, spec compliant Python 3.14+ tokenizer that runs on
older Pythons.
Number of commits found: 4